[ 527.793416] env[66274]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 527.793416] env[66274]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 528.804346] env[66364]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 528.804346] env[66364]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 530.367061] env[66364]: INFO neutron.common.config [-] Logging enabled! [ 530.367782] env[66364]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev20 [ 530.367782] env[66364]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66364) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 530.368229] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 530.368229] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 530.368820] env[66364]: WARNING oslo_policy.policy [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 530.369036] env[66364]: WARNING oslo_policy.policy [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 530.370699] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] VMware NSXv3 Agent initialized successfully. [ 530.371079] env[66364]: DEBUG oslo_concurrency.lockutils [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] Acquiring lock "singleton_lock" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.371220] env[66364]: DEBUG oslo_concurrency.lockutils [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] Acquired lock "singleton_lock" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.371444] env[66364]: DEBUG oslo_concurrency.lockutils [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] Releasing lock "singleton_lock" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.371628] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] Full set of CONF: {{(pid=66364) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 530.371737] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ******************************************************************************** {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 530.372846] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] Configuration options gathered from: {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 530.372846] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 530.372846] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 530.372846] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ================================================================================ {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 530.372846] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] agent_down_time = 75 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.372846] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] allow_automatic_dhcp_failover = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.373420] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] allow_bulk = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.373420] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] api_extensions_path = {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.373420] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] api_paste_config = api-paste.ini {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.373420] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] auth_strategy = keystone {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.373420] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] backdoor_port = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.373803] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] backdoor_socket = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.373803] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] backlog = 4096 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.373803] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374205] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] bind_host = 0.0.0.0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374205] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] bind_port = 9696 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374205] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] client_socket_timeout = 900 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374508] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] config_dir = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374508] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374508] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] config_source = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374666] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] control_exchange = neutron {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374714] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] core_plugin = ml2 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374839] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] debug = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.374969] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] default_availability_zones = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.375203] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.375343] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] dhcp_agent_notification = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.375476] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] dhcp_agents_per_network = 1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.375605] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] dhcp_lease_duration = 86400 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.375742] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] dhcp_load_type = networks {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.375878] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] dns_domain = openstacklocal {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.376022] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.376154] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] enable_default_route_bfd = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.376280] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] enable_default_route_ecmp = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.376406] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] enable_dvr = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.376533] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] enable_new_agents = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.376658] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.376784] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] enable_signals = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.376911] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] enable_traditional_dhcp = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.377043] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] external_dns_driver = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.377166] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] filter_validation = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.377307] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] global_physnet_mtu = 8950 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.377436] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] graceful_shutdown_timeout = 60 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.377612] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] host = cpu-1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.377747] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] host_dvr_for_dhcp = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.377878] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] http_retries = 3 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.378038] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] instance_format = [instance: %(uuid)s] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.378154] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.378284] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ipam_driver = internal {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.378410] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ipv6_pd_enabled = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.378535] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] l3_ha = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.378664] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.378793] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] l3_ha_network_physical_name = {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.378923] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] l3_ha_network_type = {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.379066] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] log_color = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.379204] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] log_config_append = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.379336] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.379464] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] log_dir = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.379592] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] log_file = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.379697] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] log_options = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.379831] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] log_rotate_interval = 1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.379967] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] log_rotate_interval_type = days {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.380110] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] log_rotation_type = none {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.380210] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.380308] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.380442] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.380576] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.380677] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.380807] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] max_dns_nameservers = 5 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.380937] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] max_header_line = 16384 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.381099] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] max_l3_agents_per_router = 3 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.381239] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] max_logfile_count = 30 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.381367] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] max_logfile_size_mb = 200 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.381494] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] max_subnet_host_routes = 20 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.381627] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] my_ip = 10.180.1.21 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.381759] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] my_ipv6 = ::1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.381886] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] network_auto_schedule = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.382018] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] network_link_prefix = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.382154] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.382286] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] notify_nova_on_port_data_changes = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.382418] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] notify_nova_on_port_status_changes = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.382550] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] pagination_max_limit = -1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.382676] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] publish_errors = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.382804] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] rate_limit_burst = 0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.382939] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] rate_limit_except_level = CRITICAL {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.383079] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] rate_limit_interval = 0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.383213] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] retry_until_window = 30 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.383339] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] router_distributed = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.383464] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] rpc_resources_processing_step = 20 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.383589] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] rpc_response_max_timeout = 600 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.383717] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] rpc_response_timeout = 60 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.383847] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] send_events_interval = 2 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.383996] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] service_plugins = ['router'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.384145] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] setproctitle = on {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.384274] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] shell_completion = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.384407] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] state_path = /opt/stack/data/neutron {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.384538] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] syslog_log_facility = LOG_USER {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.384669] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] tcp_keepidle = 600 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.384802] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] transport_url = **** {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.384931] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] use_journal = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.385069] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] use_json = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.385198] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] use_ssl = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.385324] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] use_stderr = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.385457] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] use_syslog = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.385582] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] vlan_qinq = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.385706] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] vlan_transparent = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.385830] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] watch_log_file = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.385959] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] wsgi_default_pool_size = 100 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.386098] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] wsgi_keep_alive = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.386233] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.386360] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] wsgi_server_debug = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 530.386505] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_concurrency.disable_process_locking = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.386645] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.386783] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.386920] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.387073] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.387211] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.387343] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.387489] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.connection_string = messaging:// {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.387632] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.enabled = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.387767] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.es_doc_type = notification {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.387898] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.es_scroll_size = 10000 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.388042] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.es_scroll_time = 2m {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.388174] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.filter_error_trace = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.388309] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.hmac_keys = **** {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.388443] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.sentinel_service_name = mymaster {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.388581] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.socket_timeout = 0.1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.388712] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.trace_requests = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.388842] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler.trace_sqlalchemy = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.388985] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler_jaeger.process_tags = {} {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.389127] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler_jaeger.service_name_prefix = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.389260] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] profiler_otlp.service_name_prefix = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.389406] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.enforce_new_defaults = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.389680] env[66364]: WARNING oslo_config.cfg [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 530.389836] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.enforce_scope = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.389978] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.policy_default_rule = default {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.390140] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.390280] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.390419] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.390551] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.390677] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.390804] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.390936] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.391083] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.391230] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.391375] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] agent.extensions = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.391514] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.391652] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] service_providers.service_provider = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.391792] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.default_quota = -1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.391929] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.392072] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.quota_floatingip = 50 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.392205] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.quota_network = 100 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.392334] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.quota_port = 500 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.392463] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.392591] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.quota_router = 10 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.392723] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.quota_security_group = 10 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.392855] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.392983] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.quota_subnet = 100 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.393126] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] QUOTAS.track_quota_usage = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.393272] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.393403] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep.group = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.393531] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep.helper_command = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.393663] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep.log_daemon_traceback = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.393799] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.393935] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep.thread_pool_size = 8 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.394075] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep.user = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.394217] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.394345] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_dhcp_release.group = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.394473] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_dhcp_release.helper_command = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.394603] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.394734] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.394866] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.394993] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_dhcp_release.user = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.395140] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.395267] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_ovs_vsctl.group = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.395393] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.395521] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.395651] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.395783] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.395910] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_ovs_vsctl.user = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.396055] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_namespace.capabilities = [21] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.396184] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_namespace.group = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.396308] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_namespace.helper_command = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.396440] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.396571] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.396703] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.396831] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_namespace.user = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.396967] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_conntrack.capabilities = [12] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.397106] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_conntrack.group = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.397233] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_conntrack.helper_command = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.397363] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.397495] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.397630] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.397756] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_conntrack.user = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.397893] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_link.capabilities = [12, 21] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.398027] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_link.group = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.398153] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_link.helper_command = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.398285] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_link.log_daemon_traceback = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.398416] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.398546] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_link.thread_pool_size = 8 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.398670] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] privsep_link.user = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.398816] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.398960] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.399107] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.continue_on_failed_promotions = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.399237] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.dscp = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.399368] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.dscp_inherit = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.399506] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.force_mp_to_policy = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.399637] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.locking_coordinator_url = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.399782] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.log_agent_heartbeats = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.399911] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.logging_expire = 1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.400057] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.400192] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.400332] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.polling_interval = 240 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.400466] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.400604] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.400848] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.report_interval = 30.0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.400919] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.401026] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.401165] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.401301] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.sync_skew = 60 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.401435] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.synchronization_queue_size = 20 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.401568] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT.use_helper_for_ns_read = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.401710] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] SECURITYGROUP.enable_ipset = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.401848] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] SECURITYGROUP.enable_security_group = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.401983] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.402135] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.402272] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] experimental.ipv6_pd_enabled = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.402424] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ml2.extension_drivers = ['port_security'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.402552] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ml2.external_network_type = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.402695] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.402833] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ml2.overlay_ip_version = 4 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.402969] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ml2.path_mtu = 8950 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.403117] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ml2.physical_network_mtus = {} {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.403260] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.403398] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.403535] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ml2.type_drivers = ['vlan'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.403676] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.403809] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.403941] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.404094] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.404234] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.404369] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.404505] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.404640] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.404775] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.404973] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.405127] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_login_password = **** {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.405268] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.405401] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_login_user = admin {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.405536] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.405674] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.405806] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.405936] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.406082] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.406223] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.406359] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.406491] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.406621] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.406757] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.406959] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.407054] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.407266] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.407366] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.407511] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.407645] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.407778] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.407914] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.auth_section = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.408066] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.auth_type = password {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.408201] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.408330] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.certfile = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.408460] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.collect_timing = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.408597] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.endpoint_type = public {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.408729] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.insecure = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.408856] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.keyfile = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.408995] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.region_name = RegionOne {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.409146] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.split_loggers = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.409272] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] nova.timeout = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.409406] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.auth_section = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.409545] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.auth_type = password {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.409680] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.409811] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.certfile = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.409942] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.collect_timing = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.410091] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.endpoint_type = public {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.410221] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.insecure = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.410347] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.keyfile = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.410471] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.region_name = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.410598] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.split_loggers = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.410724] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] placement.timeout = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.410868] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.auth_section = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.410993] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.auth_type = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.411130] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.cafile = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.411253] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.certfile = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.411380] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.collect_timing = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.411503] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.connect_retries = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.411623] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.connect_retry_delay = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.411748] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.enable_notifications = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.411872] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.endpoint_override = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.411996] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.insecure = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.412135] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.interface = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.412259] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.keyfile = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.412386] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.max_version = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.412510] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.min_version = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.412632] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.region_name = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.412755] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.retriable_status_codes = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.412995] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.service_name = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.412995] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.service_type = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.413146] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.split_loggers = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.413254] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.status_code_retries = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.413374] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.status_code_retry_delay = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.413495] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.timeout = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.413618] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.valid_interfaces = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.413741] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ironic.version = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.413873] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] cli_script.dry_run = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.414027] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.414151] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.414282] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.414410] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.414536] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.414663] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.414790] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.414917] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.415059] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.415198] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.415327] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.415462] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.415597] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.415726] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.415856] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.415988] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.416126] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.416251] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.416385] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.416512] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.416638] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.416764] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.416890] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.417024] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.417154] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.417282] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.417406] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.417532] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.417716] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.417811] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.417925] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.ssl = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.418073] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.418210] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.418338] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.418471] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.418603] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.418731] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.418874] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_notifications.driver = [] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.419014] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_notifications.retry = -1 {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.419159] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.419284] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 530.419385] env[66364]: DEBUG oslo_service.backend._eventlet.service [None req-3a0118a7-669f-4a1e-8396-501e1cdf5502 None None] ******************************************************************************** {{(pid=66364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 530.420565] env[66364]: DEBUG neutron.agent.securitygroups_rpc [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Init firewall settings (driver=nsxv3) {{(pid=66364) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 530.421842] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66364) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 530.422096] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] RPC agent_id: nsxm-l-01a.corp.local [ 530.424372] env[66364]: DEBUG dogpile.cache.region [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 530.424435] env[66364]: DEBUG dogpile.lock [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 530.424511] env[66364]: DEBUG dogpile.lock [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 530.424583] env[66364]: DEBUG dogpile.lock [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 530.424673] env[66364]: DEBUG dogpile.cache.region [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 530.424760] env[66364]: DEBUG dogpile.lock [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 530.424882] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 530.479947] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Session token - acquiring [ 530.481564] env[66364]: DEBUG networking_nsxv3.common.locking [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.481785] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.481855] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.482292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.495243] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.786150] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 530.812538] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 530.812732] env[66364]: DEBUG dogpile.cache.region [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Cache value generated in 0.388 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 530.812770] env[66364]: DEBUG dogpile.lock [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 530.812909] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Activating Policy API Provider. [ 530.813108] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Looking for the default Infrastructure Rules. [ 530.878662] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Looking for the Default Layer3 Logged Drop Section. [ 530.895558] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 530.896017] env[66364]: DEBUG networking_nsxv3.common.locking [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.896202] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquiring lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.896304] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.896585] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired external semaphore "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.896943] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.411534] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 531.914022] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 532.416641] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Inventory metadata is going to be refreshed. [ 532.417474] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 533.191749] env[66364]: DEBUG networking_nsxv3.common.locking [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.192106] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.192106] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.192453] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.204517] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 533.205384] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.205955] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 533.229910] env[66364]: DEBUG networking_nsxv3.common.locking [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.230201] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.230201] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.230488] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.230605] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.230754] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 533.230904] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.231038] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 533.251840] env[66364]: DEBUG networking_nsxv3.common.locking [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.252223] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.252337] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.252610] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.252771] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.252909] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 533.271330] env[66364]: DEBUG networking_nsxv3.common.locking [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.271605] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.271605] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.271864] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.272012] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.272226] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 533.292259] env[66364]: DEBUG networking_nsxv3.common.locking [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.292508] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquiring lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.292508] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.292799] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired external semaphore "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.292954] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Releasing lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.293123] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 533.293224] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.293321] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 533.311241] env[66364]: DEBUG networking_nsxv3.common.locking [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.311502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquiring lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.311502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.311781] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired external semaphore "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.311900] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Releasing lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.312050] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 533.312221] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.312326] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 533.331318] env[66364]: DEBUG networking_nsxv3.common.locking [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.331564] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.331564] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.331846] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.331981] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.332209] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 533.332311] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 533.332405] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Inventory metadata have been refreshed. [ 533.332497] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Dryrun:True. Metadata refresh completed. [ 533.332611] env[66364]: DEBUG oslo_concurrency.lockutils [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Releasing lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.334272] env[66364]: INFO neutron.agent.agent_extensions_manager [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Loaded agent extensions: [] [ 533.334960] env[66364]: DEBUG neutron_lib.callbacks.manager [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66364) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 533.385127] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NSXv3 Agent Agent RPC Daemon Started! [ 533.385274] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NSXv3 Agent Agent loop - iteration:0 started [ 533.385376] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NSXv3 Agent Agent out of sync with plugin! [ 538.335914] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 538.335914] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 543.336411] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 543.336833] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 548.337724] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.338121] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 548.385864] env[66364]: INFO networking_nsxv3.common.synchronization [None req-0d8642e4-2c25-4a2f-aac4-8f1de0774526 demo admin] Enqueued Resource ID: 66807ae4-a9bf-4c2b-90f9-bcccda45f041 with Priority: HIGHEST for action security_group_rules [ 548.386568] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66807ae4-a9bf-4c2b-90f9-bcccda45f041 with Priority: HIGHEST for action security_group_rules [ 548.386690] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66807ae4-a9bf-4c2b-90f9-bcccda45f041 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.386810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66807ae4-a9bf-4c2b-90f9-bcccda45f041" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.386873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66807ae4-a9bf-4c2b-90f9-bcccda45f041" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.387331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66807ae4-a9bf-4c2b-90f9-bcccda45f041" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.387416] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66807ae4-a9bf-4c2b-90f9-bcccda45f041',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.907772] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.908063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.908063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.908192] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.908287] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 548.908390] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66807ae4-a9bf-4c2b-90f9-bcccda45f041 already deleted. [ 548.908475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66807ae4-a9bf-4c2b-90f9-bcccda45f041" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.338578] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.338988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.338988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.338988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.339163] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.842122] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.344974] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.847434] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 551.847603] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 552.569190] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.569644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.569644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.569644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.581559] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 552.582372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.582976] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 552.600409] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.600634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.600634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.600793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.600879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.600986] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 552.601076] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 552.601165] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 552.618769] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.618952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.618952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.619246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.619350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.619399] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 552.640586] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.640816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.640816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.640974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.641107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.641222] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 552.661451] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.661665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.661665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.661822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.661922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.662042] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 552.662115] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 552.662185] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 552.678785] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.678981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.678981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.679210] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.679299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.679434] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 552.679512] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 552.679651] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 552.705572] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.705834] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.705834] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.705992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.706110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.706228] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 552.706298] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 552.706356] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 552.706420] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 552.706490] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 552.706551] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 552.706608] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 552.706865] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 552.706930] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 552.706999] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 552.726635] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.726818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.726818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.727029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.727134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.727242] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 552.749920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.750165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.750165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.750375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.750479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.762853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.387283] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 553.387505] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 558.388476] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.388854] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.389493] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.389896] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.390946] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.391412] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.206930] env[66364]: INFO networking_nsxv3.common.synchronization [None req-6d7bfdc6-31be-4ae4-a449-893f6d2c8fc8 None None] Enqueued Resource ID: 98cb8e5b-6903-47ca-86ab-3774d6621bfa with Priority: HIGHEST for action port [ 573.207221] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98cb8e5b-6903-47ca-86ab-3774d6621bfa with Priority: HIGHEST for action port [ 573.207772] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-98cb8e5b-6903-47ca-86ab-3774d6621bfa taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.207890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98cb8e5b-6903-47ca-86ab-3774d6621bfa" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.207968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98cb8e5b-6903-47ca-86ab-3774d6621bfa" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.209079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98cb8e5b-6903-47ca-86ab-3774d6621bfa" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.209257] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98cb8e5b-6903-47ca-86ab-3774d6621bfa',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.711405] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98cb8e5b-6903-47ca-86ab-3774d6621bfa [ 573.711798] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.712185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.712256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.712620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.712823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.713102] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98cb8e5b-6903-47ca-86ab-3774d6621bfa already deleted. [ 573.713446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98cb8e5b-6903-47ca-86ab-3774d6621bfa" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.062243] env[66364]: INFO networking_nsxv3.common.synchronization [None req-c91f53ab-1f61-4717-b455-6acdbc2bcb0a None None] Enqueued Resource ID: 78452d97-fec7-4f20-909f-3b5e00cd2282 with Priority: HIGHEST for action port [ 575.062670] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78452d97-fec7-4f20-909f-3b5e00cd2282 with Priority: HIGHEST for action port [ 575.063331] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-78452d97-fec7-4f20-909f-3b5e00cd2282 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.063331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78452d97-fec7-4f20-909f-3b5e00cd2282" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.063331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78452d97-fec7-4f20-909f-3b5e00cd2282" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.063642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78452d97-fec7-4f20-909f-3b5e00cd2282" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.063642] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78452d97-fec7-4f20-909f-3b5e00cd2282',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.566721] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78452d97-fec7-4f20-909f-3b5e00cd2282 [ 575.566953] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.567105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.567175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.567422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.567646] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.567646] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78452d97-fec7-4f20-909f-3b5e00cd2282 already deleted. [ 575.567785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78452d97-fec7-4f20-909f-3b5e00cd2282" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.447536] env[66364]: INFO networking_nsxv3.common.synchronization [None req-c151cb7b-cce0-4794-8a11-0b9380b97cb9 None None] Enqueued Resource ID: 0bd31171-8495-445b-806f-369b8d6a6354 with Priority: HIGHEST for action port [ 576.447991] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bd31171-8495-445b-806f-369b8d6a6354 with Priority: HIGHEST for action port [ 576.448197] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bd31171-8495-445b-806f-369b8d6a6354 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.448334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bd31171-8495-445b-806f-369b8d6a6354" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.448400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bd31171-8495-445b-806f-369b8d6a6354" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.448654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bd31171-8495-445b-806f-369b8d6a6354" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.448753] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bd31171-8495-445b-806f-369b8d6a6354',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.951493] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bd31171-8495-445b-806f-369b8d6a6354 [ 576.951971] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.952182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.952307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.952433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.952545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.952635] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bd31171-8495-445b-806f-369b8d6a6354 already deleted. [ 576.952843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bd31171-8495-445b-806f-369b8d6a6354" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.857225] env[66364]: INFO networking_nsxv3.common.synchronization [None req-8b338ccc-93ee-4e19-8f13-5a42505603ec None None] Enqueued Resource ID: 6a00bf9d-fdd0-4f73-ad0d-65147e7acd98 with Priority: HIGHEST for action port [ 577.858846] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a00bf9d-fdd0-4f73-ad0d-65147e7acd98 with Priority: HIGHEST for action port [ 577.858846] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a00bf9d-fdd0-4f73-ad0d-65147e7acd98 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.858846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a00bf9d-fdd0-4f73-ad0d-65147e7acd98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.858846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a00bf9d-fdd0-4f73-ad0d-65147e7acd98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.858846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a00bf9d-fdd0-4f73-ad0d-65147e7acd98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.858846] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a00bf9d-fdd0-4f73-ad0d-65147e7acd98',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.362049] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a00bf9d-fdd0-4f73-ad0d-65147e7acd98 [ 578.362280] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.362414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.362484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.362764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.362764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.362861] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a00bf9d-fdd0-4f73-ad0d-65147e7acd98 already deleted. [ 578.362941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a00bf9d-fdd0-4f73-ad0d-65147e7acd98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.400902] env[66364]: INFO networking_nsxv3.common.synchronization [None req-76b71cef-4ccd-4a2c-829e-c08feb27de6b None None] Enqueued Resource ID: 3df7ee17-95c5-4967-9b7e-7c34f674bd96 with Priority: HIGHEST for action port [ 578.402300] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df7ee17-95c5-4967-9b7e-7c34f674bd96 with Priority: HIGHEST for action port [ 578.402406] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-3df7ee17-95c5-4967-9b7e-7c34f674bd96 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.402528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3df7ee17-95c5-4967-9b7e-7c34f674bd96" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.402592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3df7ee17-95c5-4967-9b7e-7c34f674bd96" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.402938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3df7ee17-95c5-4967-9b7e-7c34f674bd96" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.403038] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3df7ee17-95c5-4967-9b7e-7c34f674bd96',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.905526] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3df7ee17-95c5-4967-9b7e-7c34f674bd96 [ 578.905838] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.905901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.906082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.906255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.906255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.906344] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3df7ee17-95c5-4967-9b7e-7c34f674bd96 already deleted. [ 578.906426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3df7ee17-95c5-4967-9b7e-7c34f674bd96" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.605559] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b1e36e62-77c3-41d0-ac57-acc87445891f None None] Enqueued Resource ID: bac83a88-b9fd-4f38-a7a4-2cc29e915ba5 with Priority: HIGHEST for action port [ 579.605559] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac83a88-b9fd-4f38-a7a4-2cc29e915ba5 with Priority: HIGHEST for action port [ 579.605559] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-bac83a88-b9fd-4f38-a7a4-2cc29e915ba5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.605559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bac83a88-b9fd-4f38-a7a4-2cc29e915ba5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.605559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bac83a88-b9fd-4f38-a7a4-2cc29e915ba5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.605904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bac83a88-b9fd-4f38-a7a4-2cc29e915ba5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.605904] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bac83a88-b9fd-4f38-a7a4-2cc29e915ba5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.107829] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bac83a88-b9fd-4f38-a7a4-2cc29e915ba5 [ 580.108174] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.108174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.108174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.108664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.108664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.108664] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bac83a88-b9fd-4f38-a7a4-2cc29e915ba5 already deleted. [ 580.108816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bac83a88-b9fd-4f38-a7a4-2cc29e915ba5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.061519] env[66364]: INFO networking_nsxv3.common.synchronization [None req-2ba29873-e1d2-4847-a3ab-9f20027424cb None None] Enqueued Resource ID: 7751bcf6-315e-43df-b671-0c3e19f26a30 with Priority: HIGHEST for action port [ 581.061519] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7751bcf6-315e-43df-b671-0c3e19f26a30 with Priority: HIGHEST for action port [ 581.061699] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7751bcf6-315e-43df-b671-0c3e19f26a30 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.062025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7751bcf6-315e-43df-b671-0c3e19f26a30" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.062025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7751bcf6-315e-43df-b671-0c3e19f26a30" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.062286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7751bcf6-315e-43df-b671-0c3e19f26a30" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.062401] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7751bcf6-315e-43df-b671-0c3e19f26a30',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.565694] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7751bcf6-315e-43df-b671-0c3e19f26a30 [ 581.566019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.566087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.566178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.566362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.566450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.566544] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7751bcf6-315e-43df-b671-0c3e19f26a30 already deleted. [ 581.566644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7751bcf6-315e-43df-b671-0c3e19f26a30" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.651054] env[66364]: INFO networking_nsxv3.common.synchronization [None req-eb91899b-52c1-435f-858f-e30f53a2c7aa None None] Enqueued Resource ID: 7f15bbd3-a7c5-49ac-a637-dd9d76200d3f with Priority: HIGHEST for action port [ 581.651054] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f15bbd3-a7c5-49ac-a637-dd9d76200d3f with Priority: HIGHEST for action port [ 581.651054] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f15bbd3-a7c5-49ac-a637-dd9d76200d3f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.651054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f15bbd3-a7c5-49ac-a637-dd9d76200d3f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.651240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f15bbd3-a7c5-49ac-a637-dd9d76200d3f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.651370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f15bbd3-a7c5-49ac-a637-dd9d76200d3f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.651453] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f15bbd3-a7c5-49ac-a637-dd9d76200d3f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.153074] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f15bbd3-a7c5-49ac-a637-dd9d76200d3f [ 582.153323] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.153460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.153524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.153803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.153895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.153895] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f15bbd3-a7c5-49ac-a637-dd9d76200d3f already deleted. [ 582.154101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f15bbd3-a7c5-49ac-a637-dd9d76200d3f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.776310] env[66364]: INFO networking_nsxv3.common.synchronization [None req-23ea2798-4280-40ab-8d26-e744a80521f0 None None] Enqueued Resource ID: 0c39149d-5071-4430-81b6-25b2293c9e13 with Priority: HIGHEST for action port [ 582.776901] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c39149d-5071-4430-81b6-25b2293c9e13 with Priority: HIGHEST for action port [ 582.777245] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c39149d-5071-4430-81b6-25b2293c9e13 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.777372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c39149d-5071-4430-81b6-25b2293c9e13" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.778590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c39149d-5071-4430-81b6-25b2293c9e13" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.778925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c39149d-5071-4430-81b6-25b2293c9e13" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.778995] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c39149d-5071-4430-81b6-25b2293c9e13',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.897879] env[66364]: INFO networking_nsxv3.common.synchronization [None req-e5d4d4b3-1047-415d-86ac-0cab35a96a03 None None] Enqueued Resource ID: c10be14d-33c0-4e84-83e7-a0fd5ed82712 with Priority: HIGHEST for action port [ 582.897879] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10be14d-33c0-4e84-83e7-a0fd5ed82712 with Priority: HIGHEST for action port [ 582.898451] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c10be14d-33c0-4e84-83e7-a0fd5ed82712 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.898596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c10be14d-33c0-4e84-83e7-a0fd5ed82712" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.898666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c10be14d-33c0-4e84-83e7-a0fd5ed82712" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.898942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c10be14d-33c0-4e84-83e7-a0fd5ed82712" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.898994] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c10be14d-33c0-4e84-83e7-a0fd5ed82712',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.281087] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c39149d-5071-4430-81b6-25b2293c9e13 [ 583.281442] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.282502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.282674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.282967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.283158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.283338] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c39149d-5071-4430-81b6-25b2293c9e13 already deleted. [ 583.283776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c39149d-5071-4430-81b6-25b2293c9e13" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.402938] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c10be14d-33c0-4e84-83e7-a0fd5ed82712 [ 583.403725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.403842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.404486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.404721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.404822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.404921] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c10be14d-33c0-4e84-83e7-a0fd5ed82712 already deleted. [ 583.405846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c10be14d-33c0-4e84-83e7-a0fd5ed82712" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.444902] env[66364]: INFO networking_nsxv3.common.synchronization [None req-7209d152-7987-4839-a75a-43166c92e58f None None] Enqueued Resource ID: 4414eca5-4e2d-486b-8edb-769f3c835a13 with Priority: HIGHEST for action port [ 583.444902] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4414eca5-4e2d-486b-8edb-769f3c835a13 with Priority: HIGHEST for action port [ 583.444902] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-4414eca5-4e2d-486b-8edb-769f3c835a13 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.444902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4414eca5-4e2d-486b-8edb-769f3c835a13" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.444902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4414eca5-4e2d-486b-8edb-769f3c835a13" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.444902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4414eca5-4e2d-486b-8edb-769f3c835a13" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.444902] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4414eca5-4e2d-486b-8edb-769f3c835a13',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.947627] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4414eca5-4e2d-486b-8edb-769f3c835a13 [ 583.947627] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.947627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.947959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.947959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.947959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.948078] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4414eca5-4e2d-486b-8edb-769f3c835a13 already deleted. [ 583.948115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4414eca5-4e2d-486b-8edb-769f3c835a13" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.752120] env[66364]: INFO networking_nsxv3.common.synchronization [None req-3c52ec59-2291-4691-a09b-119b84ab627d None None] Enqueued Resource ID: b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1 with Priority: HIGHEST for action port [ 584.752120] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1 with Priority: HIGHEST for action port [ 584.752120] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.752120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.752120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.752534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.752712] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.921839] env[66364]: INFO networking_nsxv3.common.synchronization [None req-9d3a91e4-2bb8-4d84-8f9e-12d39efcaa4e None None] Enqueued Resource ID: ac9f71f0-1ed6-471c-a8fb-db97971d3099 with Priority: HIGHEST for action port [ 584.922146] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9f71f0-1ed6-471c-a8fb-db97971d3099 with Priority: HIGHEST for action port [ 584.922659] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac9f71f0-1ed6-471c-a8fb-db97971d3099 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.922782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac9f71f0-1ed6-471c-a8fb-db97971d3099" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.922853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac9f71f0-1ed6-471c-a8fb-db97971d3099" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.923199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac9f71f0-1ed6-471c-a8fb-db97971d3099" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.923266] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac9f71f0-1ed6-471c-a8fb-db97971d3099',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.255974] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1 [ 585.255974] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.255974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.255974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.255974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.255974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.255974] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1 already deleted. [ 585.255974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b365e2d9-a4f1-46c9-ba43-8482c4ca7fc1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.426484] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac9f71f0-1ed6-471c-a8fb-db97971d3099 [ 585.426701] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.428978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.428978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.428978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.428978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.428978] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac9f71f0-1ed6-471c-a8fb-db97971d3099 already deleted. [ 585.428978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac9f71f0-1ed6-471c-a8fb-db97971d3099" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.561428] env[66364]: INFO networking_nsxv3.common.synchronization [None req-31f37dbd-a248-4440-8f9e-bef1cb9d5f0a None None] Enqueued Resource ID: b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc with Priority: HIGHEST for action port [ 585.561985] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc with Priority: HIGHEST for action port [ 585.563201] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.563201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.563201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.563201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.563201] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.065848] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc [ 586.066548] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.066548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.066548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.067180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.067314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.067486] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc already deleted. [ 586.067663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5e15ac1-c4c8-4523-ae89-ab8b0496c2fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.933974] env[66364]: INFO networking_nsxv3.common.synchronization [None req-17986258-9823-465e-a4ab-29beff43ddab None None] Enqueued Resource ID: 0a75b321-8395-47cd-8dec-6d272d88f0b1 with Priority: HIGHEST for action port [ 586.934779] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a75b321-8395-47cd-8dec-6d272d88f0b1 with Priority: HIGHEST for action port [ 586.934779] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a75b321-8395-47cd-8dec-6d272d88f0b1 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.934894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a75b321-8395-47cd-8dec-6d272d88f0b1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.934894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a75b321-8395-47cd-8dec-6d272d88f0b1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.935169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a75b321-8395-47cd-8dec-6d272d88f0b1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.935267] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a75b321-8395-47cd-8dec-6d272d88f0b1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.440021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a75b321-8395-47cd-8dec-6d272d88f0b1 [ 587.440021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.441254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.441337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.441607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.441736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.441840] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a75b321-8395-47cd-8dec-6d272d88f0b1 already deleted. [ 587.441923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a75b321-8395-47cd-8dec-6d272d88f0b1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.667175] env[66364]: INFO networking_nsxv3.common.synchronization [None req-7f7a8629-d5d8-4341-ad94-d9c03d76f8ea None None] Enqueued Resource ID: 937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8 with Priority: HIGHEST for action port [ 587.667750] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8 with Priority: HIGHEST for action port [ 587.667934] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.668081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.668664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.668664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.668664] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.172762] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8 [ 588.172762] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.172762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.172762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.172762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.172762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.172762] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8 already deleted. [ 588.172762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-937400b9-bbbd-42e1-b5d2-74f6d2d1f8a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.554182] env[66364]: INFO networking_nsxv3.common.synchronization [None req-4b32129a-f21b-4bc7-b0ae-5ddc485551de None None] Enqueued Resource ID: ecfbb1ac-1633-4f92-93cb-c69fd80562f5 with Priority: HIGHEST for action port [ 588.555278] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecfbb1ac-1633-4f92-93cb-c69fd80562f5 with Priority: HIGHEST for action port [ 588.555968] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecfbb1ac-1633-4f92-93cb-c69fd80562f5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.556129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecfbb1ac-1633-4f92-93cb-c69fd80562f5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.557620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecfbb1ac-1633-4f92-93cb-c69fd80562f5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.557620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecfbb1ac-1633-4f92-93cb-c69fd80562f5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.557620] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecfbb1ac-1633-4f92-93cb-c69fd80562f5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.590944] env[66364]: INFO networking_nsxv3.common.synchronization [None req-ec1bad58-6696-4ad3-8293-bb9c9c9f1ec0 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_rules [ 588.591842] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_rules [ 588.591842] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.592919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.592995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.593265] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.593393] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.059911] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecfbb1ac-1633-4f92-93cb-c69fd80562f5 [ 589.059911] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.059911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.059911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.060147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.060147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.060262] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecfbb1ac-1633-4f92-93cb-c69fd80562f5 already deleted. [ 589.060312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecfbb1ac-1633-4f92-93cb-c69fd80562f5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.118100] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.118245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.118312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.118516] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.118608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.118691] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b already deleted. [ 589.118769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.415019] env[66364]: INFO networking_nsxv3.common.synchronization [None req-e41a380a-a8b0-467d-899a-60dea7254c02 None None] Enqueued Resource ID: 57751524-a835-4363-b122-c934a21ac81b with Priority: HIGHEST for action port [ 589.415019] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57751524-a835-4363-b122-c934a21ac81b with Priority: HIGHEST for action port [ 589.415019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-57751524-a835-4363-b122-c934a21ac81b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.415019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57751524-a835-4363-b122-c934a21ac81b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.415019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57751524-a835-4363-b122-c934a21ac81b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.415019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57751524-a835-4363-b122-c934a21ac81b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.419414] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57751524-a835-4363-b122-c934a21ac81b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.458071] env[66364]: INFO networking_nsxv3.common.synchronization [None req-f5d84343-4ee6-4b28-88b5-bf6ffdd284c5 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_rules [ 589.458555] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_rules [ 589.458839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.458999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.460705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.461927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.461927] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.924746] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57751524-a835-4363-b122-c934a21ac81b [ 589.924746] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.924746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.924746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.924746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.924746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.924746] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57751524-a835-4363-b122-c934a21ac81b already deleted. [ 589.924746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57751524-a835-4363-b122-c934a21ac81b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.985974] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.987187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.987706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.987999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.988286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.988924] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b already deleted. [ 589.989148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.373540] env[66364]: INFO networking_nsxv3.common.synchronization [None req-442c2e43-66fb-4a0b-af96-6583922844e4 None None] Enqueued Resource ID: c67d86a8-4b3d-4960-9643-1e7d69930a9e with Priority: HIGHEST for action port [ 590.374090] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c67d86a8-4b3d-4960-9643-1e7d69930a9e with Priority: HIGHEST for action port [ 590.374388] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c67d86a8-4b3d-4960-9643-1e7d69930a9e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.374504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c67d86a8-4b3d-4960-9643-1e7d69930a9e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.374608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c67d86a8-4b3d-4960-9643-1e7d69930a9e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.377191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c67d86a8-4b3d-4960-9643-1e7d69930a9e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.377298] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c67d86a8-4b3d-4960-9643-1e7d69930a9e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.881052] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c67d86a8-4b3d-4960-9643-1e7d69930a9e [ 590.881310] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.881310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.883098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.883534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.883534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.883632] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c67d86a8-4b3d-4960-9643-1e7d69930a9e already deleted. [ 590.883672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c67d86a8-4b3d-4960-9643-1e7d69930a9e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.322351] env[66364]: INFO networking_nsxv3.common.synchronization [req-ce4d0522-d15b-4828-b304-160ad2d24d9a req-12ea9bc3-8b6f-4004-a627-9a411776d0d6 tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 591.322847] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 591.324564] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.325104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.325104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.325104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.325476] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.325476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.325628] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.325779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.325936] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.326054] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.530364] env[66364]: INFO networking_nsxv3.common.synchronization [None req-33467fb8-10e3-4f4f-a0b2-7af1d7bfb508 None None] Enqueued Resource ID: 324dbe23-0cf3-4b7c-8905-4cbbeeda8a65 with Priority: HIGHEST for action port [ 591.531120] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 324dbe23-0cf3-4b7c-8905-4cbbeeda8a65 with Priority: HIGHEST for action port [ 591.531489] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-324dbe23-0cf3-4b7c-8905-4cbbeeda8a65 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.531657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-324dbe23-0cf3-4b7c-8905-4cbbeeda8a65" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.531713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-324dbe23-0cf3-4b7c-8905-4cbbeeda8a65" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.531944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-324dbe23-0cf3-4b7c-8905-4cbbeeda8a65" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.532193] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('324dbe23-0cf3-4b7c-8905-4cbbeeda8a65',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.580476] env[66364]: INFO networking_nsxv3.common.synchronization [None req-5d5592db-44ac-4a35-b78a-01e9573a5110 None None] Enqueued Resource ID: e0a9b69b-01b1-4481-9f85-7afd2b8252b7 with Priority: HIGHEST for action port [ 591.581405] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a9b69b-01b1-4481-9f85-7afd2b8252b7 with Priority: HIGHEST for action port [ 591.583090] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0a9b69b-01b1-4481-9f85-7afd2b8252b7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.583090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0a9b69b-01b1-4481-9f85-7afd2b8252b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.583090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0a9b69b-01b1-4481-9f85-7afd2b8252b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.583090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0a9b69b-01b1-4481-9f85-7afd2b8252b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.583090] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0a9b69b-01b1-4481-9f85-7afd2b8252b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.828339] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.828492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.828556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.828799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.828893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.829115] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.829215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.829275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.829430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.829501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.829581] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 already deleted. [ 591.829658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.034479] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 324dbe23-0cf3-4b7c-8905-4cbbeeda8a65 [ 592.034782] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.035073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.035204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.035827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.035827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.035827] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:324dbe23-0cf3-4b7c-8905-4cbbeeda8a65 already deleted. [ 592.035827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-324dbe23-0cf3-4b7c-8905-4cbbeeda8a65" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.084573] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0a9b69b-01b1-4481-9f85-7afd2b8252b7 [ 592.084871] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.085043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.085119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.085377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.085929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.085929] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0a9b69b-01b1-4481-9f85-7afd2b8252b7 already deleted. [ 592.085929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0a9b69b-01b1-4481-9f85-7afd2b8252b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.375281] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-501 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.375486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.375591] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.375896] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.377725] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.377928] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.378057] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.378300] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.378443] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.378752] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.378865] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.378971] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.379087] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.379195] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.379298] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.379424] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.400970] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.401166] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.401302] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.401476] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.401847] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-3767bf96-47ef-443f-93d2-1f22554c9c12 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.402053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-3767bf96-47ef-443f-93d2-1f22554c9c12" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.402151] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-3767bf96-47ef-443f-93d2-1f22554c9c12" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.402460] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-3767bf96-47ef-443f-93d2-1f22554c9c12" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.402593] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3767bf96-47ef-443f-93d2-1f22554c9c12',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.592814] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b21187e6-448e-4aea-b2c8-48bca49a0ef6 None None] Enqueued Resource ID: 08cf39f0-b8ae-4e57-8e97-68734b1be1f5 with Priority: HIGHEST for action port [ 592.593401] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08cf39f0-b8ae-4e57-8e97-68734b1be1f5 with Priority: HIGHEST for action port [ 592.593814] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-08cf39f0-b8ae-4e57-8e97-68734b1be1f5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.593945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08cf39f0-b8ae-4e57-8e97-68734b1be1f5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.594023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08cf39f0-b8ae-4e57-8e97-68734b1be1f5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.594367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08cf39f0-b8ae-4e57-8e97-68734b1be1f5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.594451] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08cf39f0-b8ae-4e57-8e97-68734b1be1f5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.910123] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.910359] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.910481] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.910823] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.910967] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.911135] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 3767bf96-47ef-443f-93d2-1f22554c9c12 not found, creating... [ 592.911406] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.911552] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.911679] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.911958] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.912118] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.912480] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.912730] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.913538] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.913538] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.913538] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.913538] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 3767bf96-47ef-443f-93d2-1f22554c9c12 is going to be created. [ 592.936204] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.936204] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.936204] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.936204] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.936753] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.937205] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-3767bf96-47ef-443f-93d2-1f22554c9c12" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.101466] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08cf39f0-b8ae-4e57-8e97-68734b1be1f5 [ 593.101948] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.101948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.101948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.102228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.102282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.102357] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08cf39f0-b8ae-4e57-8e97-68734b1be1f5 already deleted. [ 593.102435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08cf39f0-b8ae-4e57-8e97-68734b1be1f5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.512869] env[66364]: INFO networking_nsxv3.common.synchronization [None req-662b8254-5a6a-4b91-94d7-edd8405ff987 None None] Enqueued Resource ID: 7f597e8e-ea89-45d6-86cc-5443d0000414 with Priority: HIGHEST for action port [ 593.512869] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f597e8e-ea89-45d6-86cc-5443d0000414 with Priority: HIGHEST for action port [ 593.513585] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f597e8e-ea89-45d6-86cc-5443d0000414 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.513585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f597e8e-ea89-45d6-86cc-5443d0000414" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.513585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f597e8e-ea89-45d6-86cc-5443d0000414" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.514123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f597e8e-ea89-45d6-86cc-5443d0000414" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.514199] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f597e8e-ea89-45d6-86cc-5443d0000414',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.008022] env[66364]: INFO networking_nsxv3.common.synchronization [req-ce4d0522-d15b-4828-b304-160ad2d24d9a req-8c3cf303-e3bd-46da-8bbb-ffdb724a115b service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 594.008022] env[66364]: INFO networking_nsxv3.common.synchronization [req-ce4d0522-d15b-4828-b304-160ad2d24d9a req-8c3cf303-e3bd-46da-8bbb-ffdb724a115b service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 594.008022] env[66364]: INFO networking_nsxv3.common.synchronization [req-ce4d0522-d15b-4828-b304-160ad2d24d9a req-8c3cf303-e3bd-46da-8bbb-ffdb724a115b service nova] Enqueued Resource ID: 3767bf96-47ef-443f-93d2-1f22554c9c12 with Priority: HIGHEST for action port [ 594.008022] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 594.008022] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 594.008395] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3767bf96-47ef-443f-93d2-1f22554c9c12 with Priority: HIGHEST for action port [ 594.008622] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.008744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.008817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.009064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.009155] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.010287] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.010467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.010467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.011223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.011223] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.011223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.011223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.011223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.011223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.011600] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.012467] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-3767bf96-47ef-443f-93d2-1f22554c9c12 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.012467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3767bf96-47ef-443f-93d2-1f22554c9c12" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.012622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3767bf96-47ef-443f-93d2-1f22554c9c12" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.012694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3767bf96-47ef-443f-93d2-1f22554c9c12" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.012694] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3767bf96-47ef-443f-93d2-1f22554c9c12',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.016429] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f597e8e-ea89-45d6-86cc-5443d0000414 [ 594.016603] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.016712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.016778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.016937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.017037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.017128] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f597e8e-ea89-45d6-86cc-5443d0000414 already deleted. [ 594.017235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f597e8e-ea89-45d6-86cc-5443d0000414" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.514391] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.514681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.526998] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.528437] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3767bf96-47ef-443f-93d2-1f22554c9c12 with status ACTIVE [ 594.528512] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.528612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.528678] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.528886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.528976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.529162] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.529262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.529322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.529684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.529684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.529783] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.529783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.529884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.529998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.531229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.532758] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3767bf96-47ef-443f-93d2-1f22554c9c12 is going to be updated. [ 594.537301] env[66364]: INFO networking_nsxv3.common.synchronization [None req-f241ae85-f5e2-4cd2-98da-01cf0f07603e None None] Enqueued Resource ID: d509170d-1ede-4a85-8eda-c12fe3fe6e6f with Priority: HIGHEST for action port [ 594.537950] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d509170d-1ede-4a85-8eda-c12fe3fe6e6f with Priority: HIGHEST for action port [ 594.538317] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-d509170d-1ede-4a85-8eda-c12fe3fe6e6f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.538317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d509170d-1ede-4a85-8eda-c12fe3fe6e6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.538317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d509170d-1ede-4a85-8eda-c12fe3fe6e6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.538523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d509170d-1ede-4a85-8eda-c12fe3fe6e6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.538604] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d509170d-1ede-4a85-8eda-c12fe3fe6e6f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.555102] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.557107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.557107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.557107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.557107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.557107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3767bf96-47ef-443f-93d2-1f22554c9c12" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.035413] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.043464] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d509170d-1ede-4a85-8eda-c12fe3fe6e6f [ 595.043464] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.043464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.043464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.043464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.043464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.043464] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d509170d-1ede-4a85-8eda-c12fe3fe6e6f already deleted. [ 595.043464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d509170d-1ede-4a85-8eda-c12fe3fe6e6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.114449] env[66364]: INFO networking_nsxv3.common.synchronization [req-43503d92-65f8-4181-ace5-95b060fa5a15 req-2a033409-7695-4b22-9cae-fad0855fb531 tempest-DeleteServersAdminTestJSON-506624089 tempest-DeleteServersAdminTestJSON-506624089-project-member] Enqueued Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 595.115114] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 595.115462] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.115592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.115662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.115960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.116942] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.117034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.117999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.118276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.118323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.118416] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.527459] env[66364]: INFO networking_nsxv3.common.synchronization [None req-206370dd-2872-4afd-a57d-64f1f72a7df9 None None] Enqueued Resource ID: 457c0df9-2ea9-448c-bbd4-55a72ab54422 with Priority: HIGHEST for action port [ 595.527929] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457c0df9-2ea9-448c-bbd4-55a72ab54422 with Priority: HIGHEST for action port [ 595.528233] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-457c0df9-2ea9-448c-bbd4-55a72ab54422 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.528352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-457c0df9-2ea9-448c-bbd4-55a72ab54422" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.528414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-457c0df9-2ea9-448c-bbd4-55a72ab54422" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.528653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-457c0df9-2ea9-448c-bbd4-55a72ab54422" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.528729] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457c0df9-2ea9-448c-bbd4-55a72ab54422',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.539622] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.539746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.540568] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.541480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.541480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.541480] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be created. [ 595.574309] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.574514] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.574514] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.574803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.574803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.584850] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: UNINITIALIZED for 2s [ 595.624138] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.624319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.624394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.625156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.625156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.625156] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.625346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.625346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.625435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.625510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.625591] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a already deleted. [ 595.625668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.709592] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.709592] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.709592] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.709592] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.709592] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.709890] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.709890] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.710928] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.710928] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.710928] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.710928] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.710928] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.710928] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.711162] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.711162] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.711236] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.734627] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.734627] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.734627] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.734858] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.735403] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.735705] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.735845] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.736249] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.736603] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a0e20b-6e1a-4250-a48c-1b8d3955ba83',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.033421] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 457c0df9-2ea9-448c-bbd4-55a72ab54422 [ 596.033636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.033778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.033848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.034088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.034223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.034279] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:457c0df9-2ea9-448c-bbd4-55a72ab54422 already deleted. [ 596.034348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-457c0df9-2ea9-448c-bbd4-55a72ab54422" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.240053] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.240053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.240053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.240543] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.240631] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.240906] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port d0a0e20b-6e1a-4250-a48c-1b8d3955ba83 not found, creating... [ 596.241221] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.241408] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.241575] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.241888] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.242094] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.242503] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.242679] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.242801] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.243077] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.243219] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.243355] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: d0a0e20b-6e1a-4250-a48c-1b8d3955ba83 is going to be created. [ 596.274693] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.274920] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.275049] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.275340] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.275559] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.275836] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.870929] env[66364]: INFO networking_nsxv3.common.synchronization [None req-c8ad86e2-081d-4464-bb5d-2361dfc57977 None None] Enqueued Resource ID: 3f215920-ec1a-44dc-8b91-6d08387293be with Priority: HIGHEST for action port [ 596.871879] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f215920-ec1a-44dc-8b91-6d08387293be with Priority: HIGHEST for action port [ 596.872679] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f215920-ec1a-44dc-8b91-6d08387293be taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.872813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f215920-ec1a-44dc-8b91-6d08387293be" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.872885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f215920-ec1a-44dc-8b91-6d08387293be" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.873156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f215920-ec1a-44dc-8b91-6d08387293be" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.873239] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f215920-ec1a-44dc-8b91-6d08387293be',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.993816] env[66364]: INFO networking_nsxv3.common.synchronization [req-43503d92-65f8-4181-ace5-95b060fa5a15 req-60a7fa44-0ced-4dd7-b8ec-5db48a484df6 service nova] Enqueued Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_rules [ 596.994158] env[66364]: INFO networking_nsxv3.common.synchronization [req-43503d92-65f8-4181-ace5-95b060fa5a15 req-60a7fa44-0ced-4dd7-b8ec-5db48a484df6 service nova] Enqueued Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 596.994158] env[66364]: INFO networking_nsxv3.common.synchronization [req-43503d92-65f8-4181-ace5-95b060fa5a15 req-60a7fa44-0ced-4dd7-b8ec-5db48a484df6 service nova] Enqueued Resource ID: d0a0e20b-6e1a-4250-a48c-1b8d3955ba83 with Priority: HIGHEST for action port [ 596.995072] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_rules [ 596.995218] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 596.996190] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0a0e20b-6e1a-4250-a48c-1b8d3955ba83 with Priority: HIGHEST for action port [ 596.996190] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.996190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.996190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.996190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.996190] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.997346] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.997346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.997476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.998081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.998212] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.998322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.998651] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.998876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.999367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.999472] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.001402] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.001592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.001592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.001749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.001866] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0a0e20b-6e1a-4250-a48c-1b8d3955ba83',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.378454] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f215920-ec1a-44dc-8b91-6d08387293be [ 597.379409] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.379409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.379580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.379743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.379841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.379938] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f215920-ec1a-44dc-8b91-6d08387293be already deleted. [ 597.380033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f215920-ec1a-44dc-8b91-6d08387293be" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.505492] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.505492] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.505492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.505492] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0a0e20b-6e1a-4250-a48c-1b8d3955ba83 with status ACTIVE [ 597.505492] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.505492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.505492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.505492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.505492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.505492] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.505492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.505492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.505492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.505492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.506042] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.506042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.506042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.506042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.506042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.506042] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0a0e20b-6e1a-4250-a48c-1b8d3955ba83 is going to be updated. [ 597.534879] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.535991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.535991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.536523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.536523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.537162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0a0e20b-6e1a-4250-a48c-1b8d3955ba83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.610828] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 597.611120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.611293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.611522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.611768] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.611889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.611956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.612136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.612221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.612303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.612433] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.616470] env[66364]: INFO networking_nsxv3.common.synchronization [req-ab7bdf86-058d-4d62-a8d6-5e5a5275de12 req-8d36dd8b-22b8-460f-86f9-dba373b3743f tempest-ImagesOneServerNegativeTestJSON-519635427 tempest-ImagesOneServerNegativeTestJSON-519635427-project-member] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 597.617075] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 597.617391] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.617512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.617577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.617828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.617990] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.618104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.618162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.618320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.618405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.618496] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.011022] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.029107] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.029814] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.029814] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.029986] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.030257] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.030418] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.030541] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.030822] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.030968] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.031182] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.031290] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.031391] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.031502] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.031602] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.032443] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.032443] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.051707] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.051707] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.051707] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.052373] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.052373] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-9f2926fb-8c92-4988-abe7-3fbe10f5d569 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.052373] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-9f2926fb-8c92-4988-abe7-3fbe10f5d569" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.052665] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-9f2926fb-8c92-4988-abe7-3fbe10f5d569" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.054366] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-9f2926fb-8c92-4988-abe7-3fbe10f5d569" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.054366] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f2926fb-8c92-4988-abe7-3fbe10f5d569',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.118817] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.118817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.118817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.118817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.119046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.120080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.120080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.120080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.120080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.120080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.120246] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.120307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.120572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.120572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.120732] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.120805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.120842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.121084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.121084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.121166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.121234] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.122250] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.124770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.125963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.125963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.125963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.125963] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.125963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.125963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.125963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.125963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.125963] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f already deleted. [ 598.125963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.445727] env[66364]: INFO networking_nsxv3.common.synchronization [None req-c4e23d0a-cfcb-44b6-a2d0-3a5f1d5b2a0e None None] Enqueued Resource ID: cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0 with Priority: HIGHEST for action port [ 598.447825] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0 with Priority: HIGHEST for action port [ 598.449048] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.449048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.449048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.449048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.449591] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.513523] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.513677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.513751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.513978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.514086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.514183] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a is going to be created. [ 598.546269] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.546425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.546425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.546606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.546766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.555804] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.556035] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.556156] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.556432] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.556572] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.556716] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 9f2926fb-8c92-4988-abe7-3fbe10f5d569 not found, creating... [ 598.556967] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.557132] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.557241] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.557456] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.557659] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.558044] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.558477] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.558623] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.558860] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.558993] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.559136] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 9f2926fb-8c92-4988-abe7-3fbe10f5d569 is going to be created. [ 598.561743] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: UNINITIALIZED for 2s [ 598.592578] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.592777] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.592904] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.593225] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.593449] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.593661] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-9f2926fb-8c92-4988-abe7-3fbe10f5d569" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.627330] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 784e3e36-fad9-4cd6-a173-77329b5f03c2: rpc.has_security_group_logging(os_id): False [ 598.635064] env[66364]: INFO networking_nsxv3.common.synchronization [None req-937696d7-fa93-453d-a3f4-91b83d5cde90 None None] Enqueued Resource ID: 55655f9a-aaf8-45b0-aff7-1581b9118fde with Priority: HIGHEST for action port [ 598.635163] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55655f9a-aaf8-45b0-aff7-1581b9118fde with Priority: HIGHEST for action port [ 598.635770] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-55655f9a-aaf8-45b0-aff7-1581b9118fde taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.635899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55655f9a-aaf8-45b0-aff7-1581b9118fde" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.635965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55655f9a-aaf8-45b0-aff7-1581b9118fde" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.636542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55655f9a-aaf8-45b0-aff7-1581b9118fde" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.636616] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55655f9a-aaf8-45b0-aff7-1581b9118fde',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.679152] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.679499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.679653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.679970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.680169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.680448] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.680672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.680842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.681143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.682029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.682029] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.682029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.682029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.682029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.682029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.682459] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.682677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.682840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.683128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.683303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.683468] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be created. [ 598.769990] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.770355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.770477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.770793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.771021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.797964] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 598.952801] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0 [ 598.953122] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.953269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.953336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.953563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.953641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.953730] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0 already deleted. [ 598.953856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbaa3d02-ff04-4fdc-8d18-b6bb27dcd4b0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.138817] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55655f9a-aaf8-45b0-aff7-1581b9118fde [ 599.139719] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.139719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.139719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.139719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.139719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.139902] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55655f9a-aaf8-45b0-aff7-1581b9118fde already deleted. [ 599.139902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55655f9a-aaf8-45b0-aff7-1581b9118fde" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.343241] env[66364]: INFO networking_nsxv3.common.synchronization [None req-6b64e572-d901-423a-8043-756038cbfd6b None None] Enqueued Resource ID: 654b7179-9370-494e-9899-04aee8574792 with Priority: HIGHEST for action port [ 599.343241] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654b7179-9370-494e-9899-04aee8574792 with Priority: HIGHEST for action port [ 599.343725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-654b7179-9370-494e-9899-04aee8574792 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.345906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-654b7179-9370-494e-9899-04aee8574792" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.345906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-654b7179-9370-494e-9899-04aee8574792" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.345906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-654b7179-9370-494e-9899-04aee8574792" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.345906] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('654b7179-9370-494e-9899-04aee8574792',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.521957] env[66364]: INFO networking_nsxv3.common.synchronization [req-ab7bdf86-058d-4d62-a8d6-5e5a5275de12 req-84ea5f7d-b599-44e2-a442-384fe228b7ca service nova] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_rules [ 599.521957] env[66364]: INFO networking_nsxv3.common.synchronization [req-ab7bdf86-058d-4d62-a8d6-5e5a5275de12 req-84ea5f7d-b599-44e2-a442-384fe228b7ca service nova] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 599.521957] env[66364]: INFO networking_nsxv3.common.synchronization [req-ab7bdf86-058d-4d62-a8d6-5e5a5275de12 req-84ea5f7d-b599-44e2-a442-384fe228b7ca service nova] Enqueued Resource ID: 9f2926fb-8c92-4988-abe7-3fbe10f5d569 with Priority: HIGHEST for action port [ 599.521957] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_rules [ 599.521957] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 599.521957] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2926fb-8c92-4988-abe7-3fbe10f5d569 with Priority: HIGHEST for action port [ 599.521957] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.521957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.521957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.521957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.521957] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.521957] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.522406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.522440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.522636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.522790] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.522888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.522945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.523143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.523232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.523322] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.526504] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f2926fb-8c92-4988-abe7-3fbe10f5d569 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.526718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f2926fb-8c92-4988-abe7-3fbe10f5d569" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.526794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f2926fb-8c92-4988-abe7-3fbe10f5d569" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.527060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f2926fb-8c92-4988-abe7-3fbe10f5d569" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.527184] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f2926fb-8c92-4988-abe7-3fbe10f5d569',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.847370] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 654b7179-9370-494e-9899-04aee8574792 [ 599.847683] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.847804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.847858] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.848054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.848149] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.848242] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:654b7179-9370-494e-9899-04aee8574792 already deleted. [ 599.848366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-654b7179-9370-494e-9899-04aee8574792" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.028911] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.029111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.029311] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.030270] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f2926fb-8c92-4988-abe7-3fbe10f5d569 with status ACTIVE [ 600.030469] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.030576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.030632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.030913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.031021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.031207] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.031315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.031381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.031532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.031604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.032524] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.032641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.032709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.032929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.033104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.033469] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f2926fb-8c92-4988-abe7-3fbe10f5d569 is going to be updated. [ 600.061499] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.061499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.061499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.061499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.061908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.061908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f2926fb-8c92-4988-abe7-3fbe10f5d569" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.450605] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b719b595-b447-4ead-9a08-fd66912c88ea None None] Enqueued Resource ID: 462e4ede-3316-4f25-9bb8-d775a84113f9 with Priority: HIGHEST for action port [ 600.450605] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462e4ede-3316-4f25-9bb8-d775a84113f9 with Priority: HIGHEST for action port [ 600.450605] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-462e4ede-3316-4f25-9bb8-d775a84113f9 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.450605] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-462e4ede-3316-4f25-9bb8-d775a84113f9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.450605] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-462e4ede-3316-4f25-9bb8-d775a84113f9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.450605] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-462e4ede-3316-4f25-9bb8-d775a84113f9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.450605] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('462e4ede-3316-4f25-9bb8-d775a84113f9',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.536195] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.572357] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: SUCCESS [ 600.572357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.572491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.572668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.572862] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.572978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.573052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.573213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.573341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.573412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.573493] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.792140] env[66364]: INFO networking_nsxv3.common.synchronization [None req-90bd7744-f317-4392-86da-5f4f0f89b6c7 tempest-VolumesAssistedSnapshotsTest-1793212956 tempest-VolumesAssistedSnapshotsTest-1793212956-project-member] Enqueued Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_rules [ 600.792140] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_rules [ 600.792441] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.792565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.793049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.793049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.793184] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.808803] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 600.809073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.905517] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b01fdd69-3597-472b-8aea-8429db0ed994 tempest-ServersTestBootFromVolume-733094098 tempest-ServersTestBootFromVolume-733094098-project-member] Enqueued Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_rules [ 600.906598] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_rules [ 600.907321] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02c59c8a-da67-420a-8de3-ef613658b83d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.907321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.907321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.907708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.907708] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.926498] env[66364]: INFO networking_nsxv3.common.synchronization [None req-cb817a97-65b3-4dda-bc3e-3ea10db16c09 tempest-VolumesAssistedSnapshotsTest-1793212956 tempest-VolumesAssistedSnapshotsTest-1793212956-project-member] Enqueued Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_rules [ 600.927391] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_rules [ 600.927391] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.927554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.956152] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 462e4ede-3316-4f25-9bb8-d775a84113f9 [ 600.956385] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.956517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.956585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.956923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.956923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.957029] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:462e4ede-3316-4f25-9bb8-d775a84113f9 already deleted. [ 600.957060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-462e4ede-3316-4f25-9bb8-d775a84113f9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.040109] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.040749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.040902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.041099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.041186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.041324] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be created. [ 601.066646] env[66364]: INFO networking_nsxv3.common.synchronization [None req-5f5160c3-6b8b-4b23-9320-24b9def1587e tempest-ServersTestBootFromVolume-733094098 tempest-ServersTestBootFromVolume-733094098-project-member] Enqueued Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_rules [ 601.067920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.068423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.068423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.068660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.068894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.070715] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_rules [ 601.070715] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02c59c8a-da67-420a-8de3-ef613658b83d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.070950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.076586] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.076586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.076586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.076796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.076968] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.077084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.077143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.077342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.077384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.077460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.077602] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.077685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.077757] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.078137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.078137] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.078137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.078328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.078328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.078448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.078513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.078543] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.080312] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: UNINITIALIZED for 2s [ 601.313919] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.314117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.314184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.314358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.314449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.314539] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 already deleted. [ 601.314620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.314937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.314937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.315045] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.431575] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.431575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.431575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.431820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.431820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.431927] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02c59c8a-da67-420a-8de3-ef613658b83d already deleted. [ 601.431978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.432196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.432286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.432451] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.435369] env[66364]: INFO networking_nsxv3.common.synchronization [None req-a12ee14f-5b43-4853-aa17-0a45ffc08419 None None] Enqueued Resource ID: 059501f7-86fa-467f-9162-341951b4f319 with Priority: HIGHEST for action port [ 601.437513] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 059501f7-86fa-467f-9162-341951b4f319 with Priority: HIGHEST for action port [ 601.437513] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-059501f7-86fa-467f-9162-341951b4f319 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.437513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-059501f7-86fa-467f-9162-341951b4f319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.437513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-059501f7-86fa-467f-9162-341951b4f319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.437513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-059501f7-86fa-467f-9162-341951b4f319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.437513] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('059501f7-86fa-467f-9162-341951b4f319',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.582445] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b57d473-6bcb-4eff-94aa-74472df3d57a: rpc.has_security_group_logging(os_id): False [ 601.608444] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.608444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.608444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.608444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.608444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.608444] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.608444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.608444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.608444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.608444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.608444] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.609248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.609248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.609248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.609248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.609248] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.609248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.609248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.609618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.611135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.611266] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a is going to be created. [ 601.671843] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.673574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.673574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.673574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.673574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.686187] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: IN_PROGRESS for 2s [ 601.846234] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.846387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.846447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.847859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.847859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.847859] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 already deleted. [ 601.847859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.941219] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 059501f7-86fa-467f-9162-341951b4f319 [ 601.941325] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.941449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.941857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.941857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.941857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.941999] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:059501f7-86fa-467f-9162-341951b4f319 already deleted. [ 601.942054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-059501f7-86fa-467f-9162-341951b4f319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.030325] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.030325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.030325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.030325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.030539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.030539] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02c59c8a-da67-420a-8de3-ef613658b83d already deleted. [ 602.030539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.831987] env[66364]: INFO networking_nsxv3.common.synchronization [None req-1138303f-d3bb-4c0f-b4bd-49056cd56482 None None] Enqueued Resource ID: 33915302-4691-44d6-8383-e5223005bceb with Priority: HIGHEST for action port [ 602.832626] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33915302-4691-44d6-8383-e5223005bceb with Priority: HIGHEST for action port [ 602.832931] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-33915302-4691-44d6-8383-e5223005bceb taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.833185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33915302-4691-44d6-8383-e5223005bceb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.833316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33915302-4691-44d6-8383-e5223005bceb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.833582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33915302-4691-44d6-8383-e5223005bceb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.833663] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33915302-4691-44d6-8383-e5223005bceb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.093773] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 603.093908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.093988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.094214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.095363] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.095363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.095363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.095363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.095363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.095363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.095363] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.336691] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33915302-4691-44d6-8383-e5223005bceb [ 603.336944] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.337096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.337162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.337377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.337467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.337559] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33915302-4691-44d6-8383-e5223005bceb already deleted. [ 603.337639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33915302-4691-44d6-8383-e5223005bceb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.598735] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.598907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.598907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.599192] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.599304] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.599510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.599510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.599625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.599696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.601618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.601618] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.601618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.601618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.601806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.601955] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.602088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.603115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.603115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.603115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.603115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.603115] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.699762] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: SUCCESS [ 603.700708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.104886] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 296f3936-dac0-44a8-a46a-d39ee062c69f: rpc.has_security_group_logging(os_id): False [ 604.132028] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.133256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.133256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.133256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.133256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.133256] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.133256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.133256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.133256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.133256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.136446] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.136587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.136656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.136828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.137029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.137181] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.137292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.137360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.137502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.137592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.137762] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be created. [ 604.205419] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.205519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.205586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.205812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.205990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.219926] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 604.452738] env[66364]: INFO networking_nsxv3.common.synchronization [req-7975676f-e860-4bfa-a67b-1ec008e2eb1c req-a5b997cd-a4a4-4a63-8aec-38a7bde5df91 tempest-MigrationsAdminTest-172536833 tempest-MigrationsAdminTest-172536833-project-member] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 604.453365] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 604.453603] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.453739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.455548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.455548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.455548] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.455548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.455548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.455775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.455933] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.455980] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.545343] env[66364]: INFO networking_nsxv3.common.synchronization [None req-4b501ec6-b514-4d96-bea5-724cff61d427 None None] Enqueued Resource ID: 1b7e5f5d-30e3-49d4-b337-b91a3688a27e with Priority: HIGHEST for action port [ 604.545343] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7e5f5d-30e3-49d4-b337-b91a3688a27e with Priority: HIGHEST for action port [ 604.546064] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b7e5f5d-30e3-49d4-b337-b91a3688a27e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.546064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b7e5f5d-30e3-49d4-b337-b91a3688a27e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.546956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b7e5f5d-30e3-49d4-b337-b91a3688a27e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.546956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b7e5f5d-30e3-49d4-b337-b91a3688a27e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.547098] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b7e5f5d-30e3-49d4-b337-b91a3688a27e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.826762] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.826762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.826762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.826762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.826762] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.826762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.826762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.827313] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.827313] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.827313] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.827313] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.827500] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.827536] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.828263] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.828263] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.828263] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.853347] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.853546] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.853631] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.853819] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.854856] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.854856] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.854856] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.854856] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.855450] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eeb5ff4-79b8-4af5-b11f-0b2a57b85946',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.955717] env[66364]: INFO networking_nsxv3.common.synchronization [None req-cb452d06-a3c5-4e22-8d69-7e652c866790 None None] Enqueued Resource ID: 6a580596-8a1c-4949-9bbc-c549d05e79b2 with Priority: HIGHEST for action port [ 604.956658] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a580596-8a1c-4949-9bbc-c549d05e79b2 with Priority: HIGHEST for action port [ 604.956658] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a580596-8a1c-4949-9bbc-c549d05e79b2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.956937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a580596-8a1c-4949-9bbc-c549d05e79b2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.956937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a580596-8a1c-4949-9bbc-c549d05e79b2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.957169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a580596-8a1c-4949-9bbc-c549d05e79b2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.957266] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a580596-8a1c-4949-9bbc-c549d05e79b2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.958203] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.958309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.958369] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.958551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.958643] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.958858] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.959022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.959022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.959206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.959301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.959362] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 already deleted. [ 604.959444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.052240] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b7e5f5d-30e3-49d4-b337-b91a3688a27e [ 605.052240] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.052353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.052499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.052673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.052767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.054197] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b7e5f5d-30e3-49d4-b337-b91a3688a27e already deleted. [ 605.054197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b7e5f5d-30e3-49d4-b337-b91a3688a27e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.361434] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.361737] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.361846] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.362884] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.363062] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.363256] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 2eeb5ff4-79b8-4af5-b11f-0b2a57b85946 not found, creating... [ 605.363540] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.363703] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.363836] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.364066] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.364229] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.364614] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.364743] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.364743] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.364958] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.365131] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.365227] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 2eeb5ff4-79b8-4af5-b11f-0b2a57b85946 is going to be created. [ 605.387131] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.387375] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.387507] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.387818] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.388087] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.388314] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.460535] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a580596-8a1c-4949-9bbc-c549d05e79b2 [ 605.460770] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.460990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.461077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.461330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.461453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.461563] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a580596-8a1c-4949-9bbc-c549d05e79b2 already deleted. [ 605.461652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a580596-8a1c-4949-9bbc-c549d05e79b2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.222325] env[66364]: INFO networking_nsxv3.common.synchronization [req-7975676f-e860-4bfa-a67b-1ec008e2eb1c req-2fa738c8-bd41-4bce-b088-3244a0d01c93 service nova] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_rules [ 606.222585] env[66364]: INFO networking_nsxv3.common.synchronization [req-7975676f-e860-4bfa-a67b-1ec008e2eb1c req-2fa738c8-bd41-4bce-b088-3244a0d01c93 service nova] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 606.222762] env[66364]: INFO networking_nsxv3.common.synchronization [req-7975676f-e860-4bfa-a67b-1ec008e2eb1c req-2fa738c8-bd41-4bce-b088-3244a0d01c93 service nova] Enqueued Resource ID: 2eeb5ff4-79b8-4af5-b11f-0b2a57b85946 with Priority: HIGHEST for action port [ 606.226744] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_rules [ 606.226744] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 606.226744] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eeb5ff4-79b8-4af5-b11f-0b2a57b85946 with Priority: HIGHEST for action port [ 606.227232] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.227298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.229706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.229706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.229706] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.229706] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.229706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.229706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.230159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.230159] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.230285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.230367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.230685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.230885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.231070] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.232426] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.232584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.232649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.232859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.232938] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eeb5ff4-79b8-4af5-b11f-0b2a57b85946',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.256181] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 606.256590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.657045] env[66364]: INFO networking_nsxv3.common.synchronization [req-d74a9641-58fb-4928-89fd-5f8a1441e9e1 req-0a12dd14-e850-4908-8b64-d037ed2cd457 tempest-ServersAdminTestJSON-1239172367 tempest-ServersAdminTestJSON-1239172367-project-member] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 606.657690] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 606.658026] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.658342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.658402] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.658671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.658839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.658974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.659066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.659274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.659377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.659517] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.737399] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.738923] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.738923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.739160] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2eeb5ff4-79b8-4af5-b11f-0b2a57b85946 with status ACTIVE [ 606.739307] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.739471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.739551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.739777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.739868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.742768] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.742961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.742961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.743831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.743831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.743831] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.743831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.743831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.743831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.744108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.744108] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2eeb5ff4-79b8-4af5-b11f-0b2a57b85946 is going to be updated. [ 606.774013] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.775078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.775078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.775078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.775078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.775078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eeb5ff4-79b8-4af5-b11f-0b2a57b85946" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.136983] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-585 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.136983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.136983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.136983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.136983] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.136983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.137729] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.137729] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.137729] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.137826] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.137935] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.138114] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.138199] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.138343] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.138441] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.138573] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.160096] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.160096] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.160096] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.160096] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.160096] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-e62e8548-900a-450b-ba96-17f591d86778 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.160096] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-e62e8548-900a-450b-ba96-17f591d86778" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.160096] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-e62e8548-900a-450b-ba96-17f591d86778" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.160096] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-e62e8548-900a-450b-ba96-17f591d86778" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.160096] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e62e8548-900a-450b-ba96-17f591d86778',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.161853] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.161853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.162070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.162147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.162328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.162499] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.164277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.164277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.164277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.164277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.164277] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 already deleted. [ 607.164277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.247411] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.536102] env[66364]: INFO networking_nsxv3.common.synchronization [None req-08453615-bf70-4900-9aec-874ff2f2ab31 None None] Enqueued Resource ID: 29ed9f63-d91b-4d23-807f-408b1bf6c80e with Priority: HIGHEST for action port [ 607.537925] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ed9f63-d91b-4d23-807f-408b1bf6c80e with Priority: HIGHEST for action port [ 607.537925] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-29ed9f63-d91b-4d23-807f-408b1bf6c80e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.537925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29ed9f63-d91b-4d23-807f-408b1bf6c80e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.537925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29ed9f63-d91b-4d23-807f-408b1bf6c80e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.537925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29ed9f63-d91b-4d23-807f-408b1bf6c80e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.537925] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29ed9f63-d91b-4d23-807f-408b1bf6c80e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.665949] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.665949] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.665949] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.665949] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.665949] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.665949] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port e62e8548-900a-450b-ba96-17f591d86778 not found, creating... [ 607.665949] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.665949] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.665949] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.665949] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.665949] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.666964] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.666964] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.666964] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.666964] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.666964] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.666964] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: e62e8548-900a-450b-ba96-17f591d86778 is going to be created. [ 607.694722] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.695009] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.695152] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.695429] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.695649] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.695931] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-e62e8548-900a-450b-ba96-17f591d86778" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.752914] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.753259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.754687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.754687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.754687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.754687] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 is going to be created. [ 607.781249] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.781249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.781249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.781249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.781540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.804427] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: UNINITIALIZED for 2s [ 608.043808] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29ed9f63-d91b-4d23-807f-408b1bf6c80e [ 608.043808] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.043808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.043808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.043808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.043808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.043808] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29ed9f63-d91b-4d23-807f-408b1bf6c80e already deleted. [ 608.043808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29ed9f63-d91b-4d23-807f-408b1bf6c80e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.487675] env[66364]: INFO networking_nsxv3.common.synchronization [req-d74a9641-58fb-4928-89fd-5f8a1441e9e1 req-d6bf90fb-5f30-434c-8a97-1a74a410cf2f service nova] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_rules [ 608.487867] env[66364]: INFO networking_nsxv3.common.synchronization [req-d74a9641-58fb-4928-89fd-5f8a1441e9e1 req-d6bf90fb-5f30-434c-8a97-1a74a410cf2f service nova] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 608.487998] env[66364]: INFO networking_nsxv3.common.synchronization [req-d74a9641-58fb-4928-89fd-5f8a1441e9e1 req-d6bf90fb-5f30-434c-8a97-1a74a410cf2f service nova] Enqueued Resource ID: e62e8548-900a-450b-ba96-17f591d86778 with Priority: HIGHEST for action port [ 608.488624] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_rules [ 608.488926] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 608.489122] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e62e8548-900a-450b-ba96-17f591d86778 with Priority: HIGHEST for action port [ 608.489436] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.489606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.489712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.489992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.490136] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.491422] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.491594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.491699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.492023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.492672] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.492672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.492672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.493632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.493632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.493632] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.494482] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e62e8548-900a-450b-ba96-17f591d86778 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.494482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e62e8548-900a-450b-ba96-17f591d86778" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.494482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e62e8548-900a-450b-ba96-17f591d86778" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.494482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e62e8548-900a-450b-ba96-17f591d86778" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.494482] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e62e8548-900a-450b-ba96-17f591d86778',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.949011] env[66364]: INFO networking_nsxv3.common.synchronization [req-878d5916-ff9e-44e4-8902-e856d0fbc32f req-85281f66-5450-4a32-8eb9-8fe5cddbfbad tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 608.949011] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 608.949372] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.949450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.949502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.949972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.950972] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.950972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.950972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.950972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.950972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.950972] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.997035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.997173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.997472] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.999122] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e62e8548-900a-450b-ba96-17f591d86778 with status ACTIVE [ 608.999122] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.999122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.999122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.999122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.999122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.999122] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.999384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.999384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.999384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.999515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.999686] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.999686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.001999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.001999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.001999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.001999] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e62e8548-900a-450b-ba96-17f591d86778 is going to be updated. [ 609.056806] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.056806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.056806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.056806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.056806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.056806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e62e8548-900a-450b-ba96-17f591d86778" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.390623] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-850 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.390623] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-850" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.390623] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-850" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.390623] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-850" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.390623] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.391385] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.391385] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.391385] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.391483] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.391681] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.391822] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.392484] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.392484] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.393167] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.393401] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.393596] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.426088] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.426288] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.426392] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.426564] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-850" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.426922] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-c892eb4d-67b2-4f13-8f8e-34fc30442df2 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.427116] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.427246] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.427575] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.427729] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c892eb4d-67b2-4f13-8f8e-34fc30442df2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.453959] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.454228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.454317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.454561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.454681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.454901] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.455132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.455189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.455361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.456029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.456029] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e already deleted. [ 609.456029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.502409] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.737862] env[66364]: INFO networking_nsxv3.common.synchronization [None req-7cd88ea4-c075-43e4-b80d-86fc90036054 None None] Enqueued Resource ID: 508d3ed4-a4d1-4e81-b851-3cf615f2247d with Priority: HIGHEST for action port [ 609.738149] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 508d3ed4-a4d1-4e81-b851-3cf615f2247d with Priority: HIGHEST for action port [ 609.738731] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-508d3ed4-a4d1-4e81-b851-3cf615f2247d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.738853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-508d3ed4-a4d1-4e81-b851-3cf615f2247d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.738948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-508d3ed4-a4d1-4e81-b851-3cf615f2247d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.739194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-508d3ed4-a4d1-4e81-b851-3cf615f2247d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.739274] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('508d3ed4-a4d1-4e81-b851-3cf615f2247d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.815116] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: SUCCESS [ 609.815337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.815955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.815955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.815955] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.816215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.816215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.816282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.816315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.816590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.816590] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.930489] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.931116] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.931116] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.931244] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.931345] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.931490] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port c892eb4d-67b2-4f13-8f8e-34fc30442df2 not found, creating... [ 609.932200] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.932356] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.932465] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.932697] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.933387] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.933387] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.933387] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.933387] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.933664] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.933664] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.933796] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 is going to be created. [ 609.953903] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.954243] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.954302] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.954745] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.954745] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.954997] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.005182] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.005332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.005392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.005612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.005694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.005786] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be created. [ 610.046056] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.046355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.046355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.046677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.046918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.063187] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: UNINITIALIZED for 2s [ 610.241648] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 508d3ed4-a4d1-4e81-b851-3cf615f2247d [ 610.241791] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.241934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.241995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.242304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.242406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.242609] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:508d3ed4-a4d1-4e81-b851-3cf615f2247d already deleted. [ 610.242609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-508d3ed4-a4d1-4e81-b851-3cf615f2247d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.319862] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.320088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.320157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.320328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.320494] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.320595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.320660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.320809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.320954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.321077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.321246] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.321340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.321400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.321544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.321678] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.321766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.321827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.321970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.322052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.322131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.322216] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.665032] env[66364]: INFO networking_nsxv3.common.synchronization [req-878d5916-ff9e-44e4-8902-e856d0fbc32f req-1ee05765-9b47-44bc-b02a-2265eb0027c5 service nova] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 610.665101] env[66364]: INFO networking_nsxv3.common.synchronization [req-878d5916-ff9e-44e4-8902-e856d0fbc32f req-1ee05765-9b47-44bc-b02a-2265eb0027c5 service nova] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 610.665278] env[66364]: INFO networking_nsxv3.common.synchronization [req-878d5916-ff9e-44e4-8902-e856d0fbc32f req-1ee05765-9b47-44bc-b02a-2265eb0027c5 service nova] Enqueued Resource ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 with Priority: HIGHEST for action port [ 610.665977] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 610.666464] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 610.666651] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 with Priority: HIGHEST for action port [ 610.667062] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.667335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.667422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.670509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.670509] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.670509] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.670509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.670509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.670509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.670509] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.670509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.670509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.670509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.670509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.670509] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.675700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c892eb4d-67b2-4f13-8f8e-34fc30442df2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.676077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.676219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.676513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.676637] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c892eb4d-67b2-4f13-8f8e-34fc30442df2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.682856] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.683135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.827518] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00f488e0-b3c6-4d70-9a6d-d812a7003523: rpc.has_security_group_logging(os_id): False [ 610.846270] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.846270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.846444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.846554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.846669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.846883] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.847042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.847398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.847398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.847398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.847566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.847702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.847762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.847910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.847982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.848176] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.848265] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.848370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.848463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.848929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.848929] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 is going to be created. [ 610.912267] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.912267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.912267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.912267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.912267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.926219] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: IN_PROGRESS for 2s [ 611.183614] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.186667] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c892eb4d-67b2-4f13-8f8e-34fc30442df2 with status ACTIVE [ 611.186667] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.186667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.186667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.186667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.186667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.186667] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.186667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.186667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.186667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.186667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.186667] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.186667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.187169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.187169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.187169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.187169] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 is going to be updated. [ 611.212051] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.212051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.212051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.212322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.212417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.212561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.452037] env[66364]: INFO networking_nsxv3.common.synchronization [req-a952904a-71a6-4fdd-b237-16554017a707 req-6702b192-cc44-4e7d-b04a-e0436306e869 tempest-ServerDiagnosticsTest-1309587073 tempest-ServerDiagnosticsTest-1309587073-project-member] Enqueued Resource ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 with Priority: HIGHEST for action security_group_members [ 611.453756] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 with Priority: HIGHEST for action security_group_members [ 611.454082] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5165fdef-bf23-471f-87fc-3248cc2d9078 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.454211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.454271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.454533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.454690] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.454791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.454859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.455019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.455140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.455468] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5165fdef-bf23-471f-87fc-3248cc2d9078',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.685517] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.750740] env[66364]: INFO networking_nsxv3.common.synchronization [None req-86e3c468-8772-4ad6-ab77-20607156ab68 None None] Enqueued Resource ID: c868e78a-13ab-4bf9-8d64-1e28a01143e8 with Priority: HIGHEST for action port [ 611.751299] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c868e78a-13ab-4bf9-8d64-1e28a01143e8 with Priority: HIGHEST for action port [ 611.751607] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c868e78a-13ab-4bf9-8d64-1e28a01143e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.751720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c868e78a-13ab-4bf9-8d64-1e28a01143e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.751791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c868e78a-13ab-4bf9-8d64-1e28a01143e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.752560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c868e78a-13ab-4bf9-8d64-1e28a01143e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.752658] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c868e78a-13ab-4bf9-8d64-1e28a01143e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.861963] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.862437] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.862596] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.862874] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.863183] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.863338] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.863447] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.863666] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.863804] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.864010] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.864150] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.864257] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.864356] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.864459] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.864556] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.864678] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.883520] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.883674] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.883804] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.883969] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.884290] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-de76d5f0-a411-4362-b469-c7a432a04f20 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.884456] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-de76d5f0-a411-4362-b469-c7a432a04f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.884568] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-de76d5f0-a411-4362-b469-c7a432a04f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.884871] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-de76d5f0-a411-4362-b469-c7a432a04f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.885009] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de76d5f0-a411-4362-b469-c7a432a04f20',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.959121] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.959121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.959121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.959121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.959121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.959121] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.959121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.959121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.959121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.959121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.959121] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 already deleted. [ 611.959121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.076902] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 612.076902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.076902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.076902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.076902] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.076902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.076902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.076902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.076902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.076902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.076902] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.188103] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.188502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.188502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.188758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.188923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.189063] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be created. [ 612.216518] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.216620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.216721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.216943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.217157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.229484] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: UNINITIALIZED for 2s [ 612.254798] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c868e78a-13ab-4bf9-8d64-1e28a01143e8 [ 612.255188] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.255264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.255336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.255562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.255653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.255747] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c868e78a-13ab-4bf9-8d64-1e28a01143e8 already deleted. [ 612.255842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c868e78a-13ab-4bf9-8d64-1e28a01143e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.392215] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.392215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.392215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.392215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.392215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.392215] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port de76d5f0-a411-4362-b469-c7a432a04f20 not found, creating... [ 612.392215] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.392215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.392215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.392215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.392215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.392632] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.392632] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.392632] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.392632] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.392632] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.392632] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: de76d5f0-a411-4362-b469-c7a432a04f20 is going to be created. [ 612.416071] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.418018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.418018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.418018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.418018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.418018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-de76d5f0-a411-4362-b469-c7a432a04f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.579194] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.579298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.579382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.579657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.579863] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.580149] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.580241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.580507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.580552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.581349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.581349] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.581349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.581349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.581349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.581349] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.581609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.581609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.581609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.581713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.581743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.581815] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.941290] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: SUCCESS [ 612.941290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.083878] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebb41e34-3a6d-4c7e-a19c-48afdcc86d62: rpc.has_security_group_logging(os_id): False [ 613.103502] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.103649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.103649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.104361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.104361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.104361] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.104361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.104361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.104692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.104692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.104775] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.104825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.104854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.105039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.105114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.105319] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.105427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.105464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.105658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.105709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.105810] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be created. [ 613.136375] env[66364]: INFO networking_nsxv3.common.synchronization [req-a952904a-71a6-4fdd-b237-16554017a707 req-0ff06437-56be-426e-b728-f7c0e09e7ad3 service nova] Enqueued Resource ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 with Priority: HIGHEST for action security_group_rules [ 613.136375] env[66364]: INFO networking_nsxv3.common.synchronization [req-a952904a-71a6-4fdd-b237-16554017a707 req-0ff06437-56be-426e-b728-f7c0e09e7ad3 service nova] Enqueued Resource ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 with Priority: HIGHEST for action security_group_members [ 613.136375] env[66364]: INFO networking_nsxv3.common.synchronization [req-a952904a-71a6-4fdd-b237-16554017a707 req-0ff06437-56be-426e-b728-f7c0e09e7ad3 service nova] Enqueued Resource ID: de76d5f0-a411-4362-b469-c7a432a04f20 with Priority: HIGHEST for action port [ 613.136375] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 with Priority: HIGHEST for action security_group_rules [ 613.136815] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 with Priority: HIGHEST for action security_group_members [ 613.136815] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de76d5f0-a411-4362-b469-c7a432a04f20 with Priority: HIGHEST for action port [ 613.136908] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5165fdef-bf23-471f-87fc-3248cc2d9078 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.137179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.137179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.137403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.138076] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5165fdef-bf23-471f-87fc-3248cc2d9078',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.138272] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5165fdef-bf23-471f-87fc-3248cc2d9078 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.138389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.138448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.138688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.138849] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.138966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.139041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.139224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.139339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.139447] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5165fdef-bf23-471f-87fc-3248cc2d9078',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.140336] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-de76d5f0-a411-4362-b469-c7a432a04f20 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.140443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de76d5f0-a411-4362-b469-c7a432a04f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.140506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de76d5f0-a411-4362-b469-c7a432a04f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.140671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de76d5f0-a411-4362-b469-c7a432a04f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.140747] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de76d5f0-a411-4362-b469-c7a432a04f20',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.172259] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.172410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.172475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.172695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.172867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.188521] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 613.555909] env[66364]: INFO networking_nsxv3.common.synchronization [req-9cac0f2c-1187-43e7-9ae2-d4dcbea2d532 req-83133153-8f41-4c57-8e5b-c17fc6c13a6e tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 613.557409] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 613.557409] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.557409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.557409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.557681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.557714] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.557810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.557852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.558042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.558141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.558235] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.642517] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5165fdef-bf23-471f-87fc-3248cc2d9078',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.643870] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5165fdef-bf23-471f-87fc-3248cc2d9078 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.643870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.644173] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de76d5f0-a411-4362-b469-c7a432a04f20 with status ACTIVE [ 613.644278] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.644360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.644498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.644787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.644787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.645125] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.645125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.645125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.645312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.645312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.645437] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.645527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.645575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.645902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.645902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.645902] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de76d5f0-a411-4362-b469-c7a432a04f20 is going to be updated. [ 613.676092] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.676092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.676092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.676092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.676092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.676092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de76d5f0-a411-4362-b469-c7a432a04f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.933067] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-319 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.933325] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.933451] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.933783] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.935028] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.935028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.935028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.935316] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.935316] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.935603] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.935866] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.935981] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.936183] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.937036] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.937036] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.937036] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.966812] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.966990] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.967142] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.967330] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.967687] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-7612e90d-b892-40fa-b029-ade609c8a613 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.967818] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-7612e90d-b892-40fa-b029-ade609c8a613" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.967931] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-7612e90d-b892-40fa-b029-ade609c8a613" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.968315] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-7612e90d-b892-40fa-b029-ade609c8a613" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.969389] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7612e90d-b892-40fa-b029-ade609c8a613',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.061510] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.061510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.061510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.061770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.061770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.062127] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.062127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.062277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.062378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.062459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.062547] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b already deleted. [ 614.062631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.144721] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5165fdef-bf23-471f-87fc-3248cc2d9078',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.245677] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 614.246285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.246285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.246467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.246602] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.246761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.246825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.247043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.247180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.247285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.247605] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.398327] env[66364]: INFO networking_nsxv3.common.synchronization [None req-4e4889e3-0e76-4fed-a302-22b2e730f96e None None] Enqueued Resource ID: 9efe6585-3962-40b5-be11-a571a60346cf with Priority: HIGHEST for action port [ 614.398327] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9efe6585-3962-40b5-be11-a571a60346cf with Priority: HIGHEST for action port [ 614.398899] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9efe6585-3962-40b5-be11-a571a60346cf taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.399236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9efe6585-3962-40b5-be11-a571a60346cf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.399422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9efe6585-3962-40b5-be11-a571a60346cf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.399859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9efe6585-3962-40b5-be11-a571a60346cf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.400086] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9efe6585-3962-40b5-be11-a571a60346cf',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.473569] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.473864] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.474050] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.474462] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.474595] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.474765] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 7612e90d-b892-40fa-b029-ade609c8a613 not found, creating... [ 614.475090] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.475281] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.475445] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.477623] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.477623] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.481250] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.481750] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.481750] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.481942] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.482179] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.482179] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 7612e90d-b892-40fa-b029-ade609c8a613 is going to be created. [ 614.515426] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.515631] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.515765] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.516057] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.516332] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.520705] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-7612e90d-b892-40fa-b029-ade609c8a613" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.648115] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.648333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.648415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.648618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.648717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.648796] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 is going to be created. [ 614.678915] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.679214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.679353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.679531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.679734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.703494] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 in Status: UNINITIALIZED for 2s [ 614.751152] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.751152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.751152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.751152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.751412] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.751412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.751412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.751559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.751658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.751727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.751882] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.751972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.752038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.752191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.752326] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.752406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.752556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.752600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.752665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.752739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.752827] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.904123] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9efe6585-3962-40b5-be11-a571a60346cf [ 614.904271] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.904517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.904517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.904749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.904864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.905049] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9efe6585-3962-40b5-be11-a571a60346cf already deleted. [ 614.905210] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9efe6585-3962-40b5-be11-a571a60346cf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.205128] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 615.205335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.256047] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0ef17dd-12b4-4751-91bb-321b509b882e: rpc.has_security_group_logging(os_id): False [ 615.279046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.279046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.279284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.279284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.279409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.279581] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.279695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.279750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.279899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.279958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.280177] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.280257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.280323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.280459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.280532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.280703] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.280786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.280900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.281180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.281180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.281240] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be created. [ 615.285074] env[66364]: INFO networking_nsxv3.common.synchronization [req-9cac0f2c-1187-43e7-9ae2-d4dcbea2d532 req-3f1505ea-a521-45ec-8f80-d46707b1fa8f service nova] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_rules [ 615.285886] env[66364]: INFO networking_nsxv3.common.synchronization [req-9cac0f2c-1187-43e7-9ae2-d4dcbea2d532 req-3f1505ea-a521-45ec-8f80-d46707b1fa8f service nova] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 615.285886] env[66364]: INFO networking_nsxv3.common.synchronization [req-9cac0f2c-1187-43e7-9ae2-d4dcbea2d532 req-3f1505ea-a521-45ec-8f80-d46707b1fa8f service nova] Enqueued Resource ID: 7612e90d-b892-40fa-b029-ade609c8a613 with Priority: HIGHEST for action port [ 615.285886] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_rules [ 615.286061] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 615.286093] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7612e90d-b892-40fa-b029-ade609c8a613 with Priority: HIGHEST for action port [ 615.286705] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.286828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.286907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.290206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.290206] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.290206] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.290206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.290206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.290206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.290206] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.290206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.290206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.290206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.290206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.290206] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.291417] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7612e90d-b892-40fa-b029-ade609c8a613 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.291417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7612e90d-b892-40fa-b029-ade609c8a613" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.291417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7612e90d-b892-40fa-b029-ade609c8a613" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.291590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7612e90d-b892-40fa-b029-ade609c8a613" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.291653] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7612e90d-b892-40fa-b029-ade609c8a613',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.355856] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.355856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.355856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.355856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.355856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.370511] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 615.773630] env[66364]: INFO networking_nsxv3.common.synchronization [req-bd2f3970-6f44-4759-a779-1d80a0f8460d req-68cd9bc7-ca65-49ba-88b4-179359a540b8 tempest-VolumesAdminNegativeTest-96897597 tempest-VolumesAdminNegativeTest-96897597-project-member] Enqueued Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGHEST for action security_group_members [ 615.774198] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGHEST for action security_group_members [ 615.774497] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9dde915-fa65-4509-8423-f46e62870074 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.774620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.774685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.774946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.775223] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.775366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.775412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.775562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.775650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.775740] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9dde915-fa65-4509-8423-f46e62870074',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.794876] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.795925] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.796063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.796238] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7612e90d-b892-40fa-b029-ade609c8a613 with status ACTIVE [ 615.796432] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.796575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.796667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.796871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.796978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.797601] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.797724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.797804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.798047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.798401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.798552] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.798725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.799170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.799170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.799170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.799332] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7612e90d-b892-40fa-b029-ade609c8a613 is going to be updated. [ 615.820403] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.820543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.820607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.821013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.821013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.821221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7612e90d-b892-40fa-b029-ade609c8a613" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.278115] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.278544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.278544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.278754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.278850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.279102] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.279233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.279311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.279517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.279608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.279706] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9dde915-fa65-4509-8423-f46e62870074 already deleted. [ 616.279816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.301122] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.513615] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-331 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.513837] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-331" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.513975] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-331" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.514303] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-331" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.514592] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.514747] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.514871] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.515103] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.515241] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.515501] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.515685] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.515809] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.515962] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.516153] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.516263] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.516422] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.536959] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.537310] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.537401] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.537496] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-331" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.537814] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-278a8f27-51c6-42f1-9b86-22fd1e03855f taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.537994] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-278a8f27-51c6-42f1-9b86-22fd1e03855f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.538111] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-278a8f27-51c6-42f1-9b86-22fd1e03855f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.538561] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-278a8f27-51c6-42f1-9b86-22fd1e03855f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.538725] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('278a8f27-51c6-42f1-9b86-22fd1e03855f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.713783] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 in Status: SUCCESS [ 616.713996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.714242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.714477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.714687] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.714807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.714868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.715037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.715123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.715208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.715298] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5165fdef-bf23-471f-87fc-3248cc2d9078',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.803594] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.803867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.803867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.804098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.804171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.804282] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be created. [ 616.832890] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.833316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.833316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.833881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.833881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.846085] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: UNINITIALIZED for 2s [ 617.041483] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.041964] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.042149] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.042551] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.042693] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.042907] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 278a8f27-51c6-42f1-9b86-22fd1e03855f not found, creating... [ 617.043315] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.043522] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.043715] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.044101] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.044334] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.044691] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.044890] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.045057] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.045332] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.045502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.045694] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 278a8f27-51c6-42f1-9b86-22fd1e03855f is going to be created. [ 617.067623] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.067923] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.068058] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.068381] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.068635] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.068858] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-278a8f27-51c6-42f1-9b86-22fd1e03855f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.217985] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5165fdef-bf23-471f-87fc-3248cc2d9078 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.218725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.219164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.219164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.219411] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.219564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.219665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.220092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.220251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.220426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.220627] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5165fdef-bf23-471f-87fc-3248cc2d9078 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.220776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.220871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.221138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.221474] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.221633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.221828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.222060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.222187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.222422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.222715] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5165fdef-bf23-471f-87fc-3248cc2d9078',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.370266] env[66364]: INFO networking_nsxv3.common.synchronization [req-5f403b11-5d9e-44ce-b115-50efdda7d24f req-ae415aa1-017a-4bc9-958f-54b062a3e1f2 tempest-DeleteServersAdminTestJSON-202448283 tempest-DeleteServersAdminTestJSON-202448283-project-admin] Enqueued Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 617.370826] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 617.373162] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.373391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.373512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.373861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.374174] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.374343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.374458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.374682] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.374820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.374965] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.387793] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 617.387793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.724990] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5165fdef-bf23-471f-87fc-3248cc2d9078: rpc.has_security_group_logging(os_id): False [ 617.747153] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.747361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.747451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.747697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.747887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.748130] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.748253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.748314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.748536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.748856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.748856] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.748963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.748963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.749201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.749283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.749468] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.749562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.749637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.749841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.749919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.750037] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 is going to be created. [ 617.795422] env[66364]: INFO networking_nsxv3.common.synchronization [req-bd2f3970-6f44-4759-a779-1d80a0f8460d req-586e722a-9896-4d4d-bb87-5ab1ab2f7474 service nova] Enqueued Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGHEST for action security_group_rules [ 617.795587] env[66364]: INFO networking_nsxv3.common.synchronization [req-bd2f3970-6f44-4759-a779-1d80a0f8460d req-586e722a-9896-4d4d-bb87-5ab1ab2f7474 service nova] Enqueued Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGHEST for action security_group_members [ 617.795717] env[66364]: INFO networking_nsxv3.common.synchronization [req-bd2f3970-6f44-4759-a779-1d80a0f8460d req-586e722a-9896-4d4d-bb87-5ab1ab2f7474 service nova] Enqueued Resource ID: 278a8f27-51c6-42f1-9b86-22fd1e03855f with Priority: HIGHEST for action port [ 617.796267] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGHEST for action security_group_rules [ 617.796448] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGHEST for action security_group_members [ 617.796553] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 278a8f27-51c6-42f1-9b86-22fd1e03855f with Priority: HIGHEST for action port [ 617.796866] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9dde915-fa65-4509-8423-f46e62870074 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.796945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.796993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.797294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.797404] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9dde915-fa65-4509-8423-f46e62870074',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.798750] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9dde915-fa65-4509-8423-f46e62870074 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.798997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.799101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.799297] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.799490] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.799564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.799614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.799740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.799822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.799916] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9dde915-fa65-4509-8423-f46e62870074',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.801264] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-278a8f27-51c6-42f1-9b86-22fd1e03855f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.801335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-278a8f27-51c6-42f1-9b86-22fd1e03855f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.801335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-278a8f27-51c6-42f1-9b86-22fd1e03855f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.801609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-278a8f27-51c6-42f1-9b86-22fd1e03855f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.801711] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('278a8f27-51c6-42f1-9b86-22fd1e03855f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.872887] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.873114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.873114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.873736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.873736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.878315] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.878472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.878509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.878736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.878833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.879078] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.879275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.879275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.879399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.879567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.879567] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a is going to be updated. [ 617.906934] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 in Status: IN_PROGRESS for 2s [ 617.976095] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.976305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.976349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.976543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.976687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.986556] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: IN_PROGRESS for 2s [ 618.299874] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9dde915-fa65-4509-8423-f46e62870074 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.299874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.302570] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9dde915-fa65-4509-8423-f46e62870074',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.303707] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 278a8f27-51c6-42f1-9b86-22fd1e03855f with status ACTIVE [ 618.304028] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.304146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.304956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.304956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.304956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.304956] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.304956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.304956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.305373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.305373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.305665] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.306815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.306918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.307450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.307450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.307450] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 278a8f27-51c6-42f1-9b86-22fd1e03855f is going to be updated. [ 618.334378] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.334378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.334378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.334549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.335591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.335769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-278a8f27-51c6-42f1-9b86-22fd1e03855f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.457054] env[66364]: INFO networking_nsxv3.common.synchronization [req-c4d55fe5-cff7-432a-a5f1-0d86b50af398 req-e5647a14-b97d-48d9-8829-3375f7cdc2ce tempest-ServersAdminTestJSON-1239172367 tempest-ServersAdminTestJSON-1239172367-project-member] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 618.458051] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 618.459107] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.459413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.459491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.459822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.460120] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.460388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.460597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.460879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.461076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.461270] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.794218] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-585 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.794405] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.794505] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.794774] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.795027] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.795185] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.795296] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.795513] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.795663] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.795873] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.795980] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.796094] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.796197] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.796298] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.796396] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.796515] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.810452] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9dde915-fa65-4509-8423-f46e62870074',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.817442] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.817666] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.817814] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.817997] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.818382] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-5595c04f-0be2-4b3b-a05f-faddcaa698c1 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.818559] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-5595c04f-0be2-4b3b-a05f-faddcaa698c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.818684] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-5595c04f-0be2-4b3b-a05f-faddcaa698c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.819045] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-5595c04f-0be2-4b3b-a05f-faddcaa698c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.819180] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5595c04f-0be2-4b3b-a05f-faddcaa698c1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.855434] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: SUCCESS [ 618.855653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.855849] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.856170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.856407] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.856534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.856596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.856769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.856853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.856940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.857042] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.964257] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.313379] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.313823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.313823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.314105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.314176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.314294] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9dde915-fa65-4509-8423-f46e62870074 is going to be created. [ 619.324063] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.324340] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.324415] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.324685] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.325045] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.325045] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 5595c04f-0be2-4b3b-a05f-faddcaa698c1 not found, creating... [ 619.325350] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.325565] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.325630] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.325999] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.325999] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.326291] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.326455] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.326455] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.326635] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.326970] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.326970] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 5595c04f-0be2-4b3b-a05f-faddcaa698c1 is going to be created. [ 619.350118] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.350407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.350508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.350697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.350872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.353655] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.353655] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.353913] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.354031] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.354260] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.354624] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-5595c04f-0be2-4b3b-a05f-faddcaa698c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.359916] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.383607] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9dde915-fa65-4509-8423-f46e62870074 in Status: UNINITIALIZED for 2s [ 619.467575] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.863841] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad194291-e1d7-48e3-b3d4-5e26a902dc4b: rpc.has_security_group_logging(os_id): False [ 619.885026] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.885026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.885026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.885026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.885026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.885026] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.885026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.885026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.885026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.885026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.885026] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be created. [ 619.918215] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 in Status: SUCCESS [ 619.918754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.951740] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.951740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.951740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.951922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.951951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.963811] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: IN_PROGRESS for 2s [ 619.969320] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.969483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.969531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.969826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.969889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.969928] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 619.999017] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: SUCCESS [ 619.999200] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a deletion is rescheduled due to dependency. [ 619.999313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.000605] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.000753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.000797] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.000993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.001240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.008937] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 620.041084] env[66364]: INFO networking_nsxv3.common.synchronization [req-c4d55fe5-cff7-432a-a5f1-0d86b50af398 req-b2d67ebe-cef2-46c1-a15c-c1ffe1ccb2a5 service nova] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_rules [ 620.041275] env[66364]: INFO networking_nsxv3.common.synchronization [req-c4d55fe5-cff7-432a-a5f1-0d86b50af398 req-b2d67ebe-cef2-46c1-a15c-c1ffe1ccb2a5 service nova] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 620.041414] env[66364]: INFO networking_nsxv3.common.synchronization [req-c4d55fe5-cff7-432a-a5f1-0d86b50af398 req-b2d67ebe-cef2-46c1-a15c-c1ffe1ccb2a5 service nova] Enqueued Resource ID: 5595c04f-0be2-4b3b-a05f-faddcaa698c1 with Priority: HIGHEST for action port [ 620.041958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_rules [ 620.042691] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 620.042691] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5595c04f-0be2-4b3b-a05f-faddcaa698c1 with Priority: HIGHEST for action port [ 620.042879] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.043037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.043171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.043437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.043555] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.044545] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.044670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.044912] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5595c04f-0be2-4b3b-a05f-faddcaa698c1 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.045097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5595c04f-0be2-4b3b-a05f-faddcaa698c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.045196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5595c04f-0be2-4b3b-a05f-faddcaa698c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.046093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5595c04f-0be2-4b3b-a05f-faddcaa698c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.046093] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5595c04f-0be2-4b3b-a05f-faddcaa698c1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.548055] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5595c04f-0be2-4b3b-a05f-faddcaa698c1 with status ACTIVE [ 620.548310] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.548424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.548491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.548719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.548811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.549593] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.549593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.549593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.549593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.549593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.552327] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.552327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.552327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.552327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.552327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.552327] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5595c04f-0be2-4b3b-a05f-faddcaa698c1 is going to be updated. [ 620.552866] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.552866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.575866] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.575866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.575866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.575866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.576113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.576113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5595c04f-0be2-4b3b-a05f-faddcaa698c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.832029] env[66364]: INFO networking_nsxv3.common.synchronization [req-d8b34965-d139-4a48-8784-aeb8005a050b req-2d5cfa78-b5d6-4dad-9bf9-276a1373a352 tempest-FloatingIPsAssociationTestJSON-640590749 tempest-FloatingIPsAssociationTestJSON-640590749-project-member] Enqueued Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 620.832987] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 620.833261] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.833681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.833681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.833778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.833878] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.834143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.834143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.834608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.834608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.834608] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.907407] env[66364]: INFO networking_nsxv3.common.synchronization [None req-2f9bf154-0631-4c8d-afe0-996b70ba486d None None] Enqueued Resource ID: 11161170-e4c5-472a-930b-a9cc4f7b1c6d with Priority: HIGHEST for action port [ 620.907848] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11161170-e4c5-472a-930b-a9cc4f7b1c6d with Priority: HIGHEST for action port [ 620.908198] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-11161170-e4c5-472a-930b-a9cc4f7b1c6d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.908414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11161170-e4c5-472a-930b-a9cc4f7b1c6d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.908414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11161170-e4c5-472a-930b-a9cc4f7b1c6d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.908696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11161170-e4c5-472a-930b-a9cc4f7b1c6d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.908815] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11161170-e4c5-472a-930b-a9cc4f7b1c6d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.337672] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.337892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.338236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.338546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.338684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.338959] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.339085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.339882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.339882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.339882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.339882] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 already deleted. [ 621.339882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.398389] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9dde915-fa65-4509-8423-f46e62870074 in Status: SUCCESS [ 621.398389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.398389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.398389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.398389] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.398389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.398389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.398684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.398684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.398748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.398843] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9dde915-fa65-4509-8423-f46e62870074',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.413617] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11161170-e4c5-472a-930b-a9cc4f7b1c6d [ 621.414326] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.414542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.414656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.414938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.415750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.415864] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11161170-e4c5-472a-930b-a9cc4f7b1c6d already deleted. [ 621.415958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11161170-e4c5-472a-930b-a9cc4f7b1c6d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.586509] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.586859] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.586859] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.588168] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.588168] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.588168] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.588168] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.588168] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.588168] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.588546] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.588546] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.588667] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.589457] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.589457] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.589457] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.589457] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.610015] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.610269] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.610466] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.610643] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.611075] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-5f63c2ec-c31e-4c89-8a19-d55313744274 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.611273] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-5f63c2ec-c31e-4c89-8a19-d55313744274" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.611470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-5f63c2ec-c31e-4c89-8a19-d55313744274" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.612290] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-5f63c2ec-c31e-4c89-8a19-d55313744274" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.612290] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f63c2ec-c31e-4c89-8a19-d55313744274',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.901017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9dde915-fa65-4509-8423-f46e62870074 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.901245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.901327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.901555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.901744] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.904206] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9dde915-fa65-4509-8423-f46e62870074 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.904206] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.904206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.904206] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9dde915-fa65-4509-8423-f46e62870074',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.976140] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: SUCCESS [ 621.976360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.019852] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 622.020080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.020248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.020480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.020664] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.020811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.020860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.021241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.021241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.021241] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.116194] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.116194] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.116194] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.116194] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.116194] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.116194] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 5f63c2ec-c31e-4c89-8a19-d55313744274 not found, creating... [ 622.116591] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.116663] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.116790] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.116948] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.117096] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.117368] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.117508] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.117614] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.117810] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.117931] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.118246] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 5f63c2ec-c31e-4c89-8a19-d55313744274 is going to be created. [ 622.138223] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.139214] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.139214] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.139214] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.139214] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.139365] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-5f63c2ec-c31e-4c89-8a19-d55313744274" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.408269] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9dde915-fa65-4509-8423-f46e62870074: rpc.has_security_group_logging(os_id): False [ 622.431900] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.431900] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.431900] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.431900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.436750] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.436750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.436750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.436750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.436750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.436750] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9dde915-fa65-4509-8423-f46e62870074 is going to be created. [ 622.504519] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.506452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.506452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.506452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.506452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.521229] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9dde915-fa65-4509-8423-f46e62870074 in Status: IN_PROGRESS for 2s [ 622.524739] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.799807] env[66364]: INFO networking_nsxv3.common.synchronization [None req-8a471a5c-e27d-4637-be75-954492e7aacd None None] Enqueued Resource ID: 7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5 with Priority: HIGHEST for action port [ 622.800583] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5 with Priority: HIGHEST for action port [ 622.800894] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.801065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.801144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.801426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.801543] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.816940] env[66364]: INFO networking_nsxv3.common.synchronization [None req-86bf0d8c-0cfb-421f-90e5-28921b996947 None None] Enqueued Resource ID: 867ee7e8-c10a-4346-8a23-ab2469abe061 with Priority: HIGHEST for action port [ 622.817599] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 867ee7e8-c10a-4346-8a23-ab2469abe061 with Priority: HIGHEST for action port [ 622.818638] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-867ee7e8-c10a-4346-8a23-ab2469abe061 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.818886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-867ee7e8-c10a-4346-8a23-ab2469abe061" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.819315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-867ee7e8-c10a-4346-8a23-ab2469abe061" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.819540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-867ee7e8-c10a-4346-8a23-ab2469abe061" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.819958] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('867ee7e8-c10a-4346-8a23-ab2469abe061',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.866802] env[66364]: INFO networking_nsxv3.common.synchronization [req-d8b34965-d139-4a48-8784-aeb8005a050b req-90ea3de7-ade7-49f7-9a8d-b62e9c5f53c4 service nova] Enqueued Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_rules [ 622.867034] env[66364]: INFO networking_nsxv3.common.synchronization [req-d8b34965-d139-4a48-8784-aeb8005a050b req-90ea3de7-ade7-49f7-9a8d-b62e9c5f53c4 service nova] Enqueued Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 622.867187] env[66364]: INFO networking_nsxv3.common.synchronization [req-d8b34965-d139-4a48-8784-aeb8005a050b req-90ea3de7-ade7-49f7-9a8d-b62e9c5f53c4 service nova] Enqueued Resource ID: 5f63c2ec-c31e-4c89-8a19-d55313744274 with Priority: HIGHEST for action port [ 622.868195] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_rules [ 622.868427] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 622.868427] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f63c2ec-c31e-4c89-8a19-d55313744274 with Priority: HIGHEST for action port [ 622.868689] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.868862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.868931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.869191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.869269] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.870377] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.870538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.870611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.871319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.871460] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.871552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.871615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.871831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.871959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.872151] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.873092] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f63c2ec-c31e-4c89-8a19-d55313744274 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.873220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f63c2ec-c31e-4c89-8a19-d55313744274" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.873276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f63c2ec-c31e-4c89-8a19-d55313744274" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.873528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f63c2ec-c31e-4c89-8a19-d55313744274" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.873623] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f63c2ec-c31e-4c89-8a19-d55313744274',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.027685] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.306106] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5 [ 623.306106] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.306106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.306106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.306106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.306106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.306106] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5 already deleted. [ 623.306106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fb3f4f4-ef70-4e49-9009-edbc7d9b0be5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.322827] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 867ee7e8-c10a-4346-8a23-ab2469abe061 [ 623.323079] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.323236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.323291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.323563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.324762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.324762] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:867ee7e8-c10a-4346-8a23-ab2469abe061 already deleted. [ 623.324762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-867ee7e8-c10a-4346-8a23-ab2469abe061" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.375857] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.377115] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.377230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.381679] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f63c2ec-c31e-4c89-8a19-d55313744274 with status ACTIVE [ 623.381903] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.382112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.382230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.382442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.382527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.382709] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.382815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.382884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.383022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.383091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.383265] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.383348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.383430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.383611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.383695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.383760] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f63c2ec-c31e-4c89-8a19-d55313744274 is going to be updated. [ 623.407759] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.407759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.407759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.407759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.407949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.408108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f63c2ec-c31e-4c89-8a19-d55313744274" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.531743] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.531915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.532016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.532460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.532658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.532810] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 623.572558] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.572558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.572558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.572776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.572888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.590125] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 623.879124] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.060910] env[66364]: INFO networking_nsxv3.common.synchronization [req-263e0a8d-83ea-4f88-b797-9d80e4b0ffe1 req-4f640bae-3984-4df8-ac32-97ae509ed2b3 tempest-VolumesAssistedSnapshotsTest-1793212956 tempest-VolumesAssistedSnapshotsTest-1793212956-project-member] Enqueued Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_members [ 624.065098] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_members [ 624.065098] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.065098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.065098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.065098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.065098] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.065098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.065098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.065098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.065098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.065098] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.382920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.383172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.383231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.383456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.383549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.383637] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 is going to be created. [ 624.433596] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.433596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.433596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.433596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.433596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.447354] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: UNINITIALIZED for 2s [ 624.538580] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9dde915-fa65-4509-8423-f46e62870074 in Status: SUCCESS [ 624.539658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.562020] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-747 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.562020] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-747" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.562020] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-747" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.562020] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-747" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.562020] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.563321] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.563469] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.563705] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.563842] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.565184] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.565184] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.565184] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.565184] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.565184] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.565184] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.565184] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.568600] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.568747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.568747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.568924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.569024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.569206] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.569333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.569400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.569528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.569662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.569662] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 already deleted. [ 624.569909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.590484] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.591288] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.591288] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.591288] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-747" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.591536] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-8edcfd08-262c-4927-b455-90def0865a11 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.591721] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-8edcfd08-262c-4927-b455-90def0865a11" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.591836] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-8edcfd08-262c-4927-b455-90def0865a11" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.592215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-8edcfd08-262c-4927-b455-90def0865a11" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.592348] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8edcfd08-262c-4927-b455-90def0865a11',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.095085] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.095506] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.095506] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.096310] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.096807] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.097882] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 8edcfd08-262c-4927-b455-90def0865a11 not found, creating... [ 625.097882] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.098492] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.098638] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.098904] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.099292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.100022] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.100551] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.100979] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.101574] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.101950] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.102202] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 8edcfd08-262c-4927-b455-90def0865a11 is going to be created. [ 625.129350] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.129652] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.129749] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.130049] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.130242] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.130937] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-8edcfd08-262c-4927-b455-90def0865a11" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.215769] env[66364]: INFO networking_nsxv3.common.synchronization [None req-0015e1d2-6aea-4de6-b4c8-ed27c48c5b4d None None] Enqueued Resource ID: 5e0dfa3f-0c40-4d42-918d-878fb2af7e22 with Priority: HIGHEST for action port [ 625.216369] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0dfa3f-0c40-4d42-918d-878fb2af7e22 with Priority: HIGHEST for action port [ 625.217301] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e0dfa3f-0c40-4d42-918d-878fb2af7e22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.217477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e0dfa3f-0c40-4d42-918d-878fb2af7e22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.217530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e0dfa3f-0c40-4d42-918d-878fb2af7e22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.218701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e0dfa3f-0c40-4d42-918d-878fb2af7e22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.218701] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e0dfa3f-0c40-4d42-918d-878fb2af7e22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.291801] env[66364]: INFO networking_nsxv3.common.synchronization [None req-ad788788-7864-44d2-b124-669993cc8527 None None] Enqueued Resource ID: 677be480-9375-4901-9007-e4b005fc7d9f with Priority: HIGHEST for action port [ 625.292480] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 677be480-9375-4901-9007-e4b005fc7d9f with Priority: HIGHEST for action port [ 625.294945] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-677be480-9375-4901-9007-e4b005fc7d9f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.295212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-677be480-9375-4901-9007-e4b005fc7d9f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.295327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-677be480-9375-4901-9007-e4b005fc7d9f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.296087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-677be480-9375-4901-9007-e4b005fc7d9f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.296279] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('677be480-9375-4901-9007-e4b005fc7d9f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.603595] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 625.604089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.604786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.605320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.605424] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.605596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.605748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.605974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.606141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.606307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.606503] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.720498] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e0dfa3f-0c40-4d42-918d-878fb2af7e22 [ 625.724127] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.724127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.724127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.724127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.724127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.724127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e0dfa3f-0c40-4d42-918d-878fb2af7e22 already deleted. [ 625.724127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e0dfa3f-0c40-4d42-918d-878fb2af7e22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.798997] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 677be480-9375-4901-9007-e4b005fc7d9f [ 625.799666] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.799666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.799666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.799666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.799666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.799666] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:677be480-9375-4901-9007-e4b005fc7d9f already deleted. [ 625.800256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-677be480-9375-4901-9007-e4b005fc7d9f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.852563] env[66364]: INFO networking_nsxv3.common.synchronization [req-263e0a8d-83ea-4f88-b797-9d80e4b0ffe1 req-4480f2a0-66e2-4274-bf76-aefaf56c7b2a service nova] Enqueued Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_rules [ 625.852772] env[66364]: INFO networking_nsxv3.common.synchronization [req-263e0a8d-83ea-4f88-b797-9d80e4b0ffe1 req-4480f2a0-66e2-4274-bf76-aefaf56c7b2a service nova] Enqueued Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_members [ 625.852903] env[66364]: INFO networking_nsxv3.common.synchronization [req-263e0a8d-83ea-4f88-b797-9d80e4b0ffe1 req-4480f2a0-66e2-4274-bf76-aefaf56c7b2a service nova] Enqueued Resource ID: 8edcfd08-262c-4927-b455-90def0865a11 with Priority: HIGHEST for action port [ 625.854229] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_rules [ 625.854229] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_members [ 625.854229] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8edcfd08-262c-4927-b455-90def0865a11 with Priority: HIGHEST for action port [ 625.854229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.854719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.854889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.855181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.855294] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.856766] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.856954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.857063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.857307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.857567] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.858269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.858269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.858269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.858269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.858269] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.859158] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-8edcfd08-262c-4927-b455-90def0865a11 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.859303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8edcfd08-262c-4927-b455-90def0865a11" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.859382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8edcfd08-262c-4927-b455-90def0865a11" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.859554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8edcfd08-262c-4927-b455-90def0865a11" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.859643] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8edcfd08-262c-4927-b455-90def0865a11',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.112379] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.112739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.112739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.115169] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.115169] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.115169] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.115169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.115169] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.361671] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.361895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.362054] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.362986] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8edcfd08-262c-4927-b455-90def0865a11 with status ACTIVE [ 626.363188] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.363325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.363404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.363615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.363704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.363842] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.363949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.364045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.364151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.364226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.364397] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.364515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.364589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.365757] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.365904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.366025] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8edcfd08-262c-4927-b455-90def0865a11 is going to be updated. [ 626.390518] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.390669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.390738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.390956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.391178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.391383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8edcfd08-262c-4927-b455-90def0865a11" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.459126] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: SUCCESS [ 626.460268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.460268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.460268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.460458] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.460570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.460681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.460952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.461248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.461415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.461571] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.554443] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-cb7ca401-960d-4de1-b93b-a7a341c1f462 tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 626.556118] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 626.556118] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.556118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.556118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.556118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.556583] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.556583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.556583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.556770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.556770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.556875] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.619105] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebb41e34-3a6d-4c7e-a19c-48afdcc86d62: rpc.has_security_group_logging(os_id): False [ 626.642175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.642175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.642175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.642175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.642175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.642175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.642175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.642175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.642175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.642175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.642175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.642981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.643225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.644220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.646503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.646503] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.646503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.646503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.646503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.646503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.646503] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 626.740269] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.740269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.740269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.740269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.740269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.757688] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 626.869357] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.950175] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-b01717ba-c894-46ad-903f-3f1a8899421c tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 626.950175] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 626.950175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.950175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.964463] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.964709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.964709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.964929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.965169] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.965263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.965313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.965451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.965538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.965637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.965827] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.965904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.966027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.966082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.966222] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.966312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.966361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.966500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.966591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.966673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.966775] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.060558] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.060719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.060788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.061167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.061167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.061389] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.061553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.061589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.061758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.061867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.061960] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b already deleted. [ 627.062140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.062252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.062448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.062804] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.062804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.062804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.062944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.062983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.064129] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.158021] env[66364]: INFO networking_nsxv3.common.synchronization [None req-27cabcc9-ecc1-4c25-a463-00cfb08cd126 tempest-ServersWithSpecificFlavorTestJSON-596773426 tempest-ServersWithSpecificFlavorTestJSON-596773426-project-member] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_rules [ 627.159354] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_rules [ 627.159354] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.159354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.159598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.160303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.160303] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.375545] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.375747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.375814] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.376044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.376140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.376250] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 is going to be created. [ 627.405960] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.405960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.405960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.406773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.406773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.417674] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 in Status: UNINITIALIZED for 2s [ 627.436683] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-c7d7c3ff-00d6-4da8-b7d4-a53f3b5f22dd tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 627.437543] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 627.438062] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.438150] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.469174] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1861e5fb-2be6-4354-a9e1-67fd55022b22: rpc.has_security_group_logging(os_id): False [ 627.491501] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.491501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.491501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.491726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.491726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.491961] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.492122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.492122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.492371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.494101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.494101] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.494101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.494101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.494101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.494101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.494101] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.494101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.494101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.494101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.494101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.494101] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 is going to be created. [ 627.551826] env[66364]: INFO networking_nsxv3.common.synchronization [None req-670ca7b2-bc0a-43ba-b40e-e82d55d38bd1 tempest-ServersWithSpecificFlavorTestJSON-596773426 tempest-ServersWithSpecificFlavorTestJSON-596773426-project-member] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_rules [ 627.553192] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_rules [ 627.553628] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.553746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.555649] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.555789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.555890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.556097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.556350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.567046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.567204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.567295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.567508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.567593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.568159] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.568159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.568159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.568159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.568397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.568397] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b already deleted. [ 627.568397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.569507] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: IN_PROGRESS for 2s [ 627.569507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.570606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.570606] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.570606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.570606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.570606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.570606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.570606] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.690805] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.691118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.691118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.691272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.691869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.691869] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37506c58-083d-46d9-8010-be6545a2e954 already deleted. [ 627.691869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.692110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.692110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.692220] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.868181] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.868432] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-463" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.868498] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-463" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.868831] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-463" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.869178] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.869342] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.869450] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.869674] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.869811] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.870018] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.870155] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.870259] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.870427] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.870640] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.870889] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.871180] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.894226] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.894472] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.894688] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.894925] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-463" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.895409] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-7ea8515e-0b15-4174-9205-d28d746f0630 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.895631] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-7ea8515e-0b15-4174-9205-d28d746f0630" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.895797] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-7ea8515e-0b15-4174-9205-d28d746f0630" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.896258] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-7ea8515e-0b15-4174-9205-d28d746f0630" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.896446] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ea8515e-0b15-4174-9205-d28d746f0630',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.072537] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.072732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.072780] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.072980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.073094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.073293] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.073397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.073552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.073626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.073700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.073782] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b already deleted. [ 628.073861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.182588] env[66364]: INFO networking_nsxv3.common.synchronization [None req-1dd2584b-e0e3-430b-a2c5-c1d05f6685ae None None] Enqueued Resource ID: 83f60618-35ea-458e-9269-e510bd42afd0 with Priority: HIGHEST for action port [ 628.183673] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83f60618-35ea-458e-9269-e510bd42afd0 with Priority: HIGHEST for action port [ 628.184080] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-83f60618-35ea-458e-9269-e510bd42afd0 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.184221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83f60618-35ea-458e-9269-e510bd42afd0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.184347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83f60618-35ea-458e-9269-e510bd42afd0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.184667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83f60618-35ea-458e-9269-e510bd42afd0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.184920] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83f60618-35ea-458e-9269-e510bd42afd0',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.213160] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.213379] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.213441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.213707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.213853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.213960] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37506c58-083d-46d9-8010-be6545a2e954 already deleted. [ 628.214064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.399952] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.400251] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.400411] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.400785] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.401109] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.401336] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 7ea8515e-0b15-4174-9205-d28d746f0630 not found, creating... [ 628.401646] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.401811] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.401921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.402223] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.402382] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.402684] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.402839] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.402980] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.403287] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.403432] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.403829] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 7ea8515e-0b15-4174-9205-d28d746f0630 is going to be created. [ 628.427301] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.427512] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.427630] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.428294] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.428599] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.428871] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-7ea8515e-0b15-4174-9205-d28d746f0630" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.688502] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83f60618-35ea-458e-9269-e510bd42afd0 [ 628.688758] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.688897] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.688961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.689753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.689753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.689753] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83f60618-35ea-458e-9269-e510bd42afd0 already deleted. [ 628.689753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83f60618-35ea-458e-9269-e510bd42afd0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.772955] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 628.773228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.170770] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-7772ce55-c1c8-4795-b386-624cabfaa71a service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 629.170938] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-7772ce55-c1c8-4795-b386-624cabfaa71a service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 629.171083] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-7772ce55-c1c8-4795-b386-624cabfaa71a service nova] Enqueued Resource ID: 7ea8515e-0b15-4174-9205-d28d746f0630 with Priority: HIGHEST for action port [ 629.171395] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 629.171611] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 629.171646] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea8515e-0b15-4174-9205-d28d746f0630 with Priority: HIGHEST for action port [ 629.173420] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.173420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.173694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.173826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.173882] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.175363] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.175583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.175643] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.175879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.176858] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.176988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.177074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.177244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.177338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.177435] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.178273] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ea8515e-0b15-4174-9205-d28d746f0630 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.178372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ea8515e-0b15-4174-9205-d28d746f0630" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.178443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ea8515e-0b15-4174-9205-d28d746f0630" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.178600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ea8515e-0b15-4174-9205-d28d746f0630" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.178677] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ea8515e-0b15-4174-9205-d28d746f0630',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.437121] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 in Status: SUCCESS [ 629.437474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.438588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.438588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.438588] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.438588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.438588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.438588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.438886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.438886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.438886] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.583989] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: SUCCESS [ 629.584220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.681892] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.682356] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.682674] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.683738] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ea8515e-0b15-4174-9205-d28d746f0630 with status ACTIVE [ 629.684159] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.684545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.684755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.688424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.688424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.688632] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.688873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.688953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.689286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.689877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.689877] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.689877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.689877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.690087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.691028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.691028] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ea8515e-0b15-4174-9205-d28d746f0630 is going to be updated. [ 629.717889] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.717889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.718702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.718702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.718702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.718827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ea8515e-0b15-4174-9205-d28d746f0630" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.942399] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.065737] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.065888] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-535" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.065973] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-535" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.066319] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-535" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.066764] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.067056] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.067336] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.067590] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.067741] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.068033] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.068078] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.068182] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.068284] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.068402] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.068483] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.068606] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.092721] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.092721] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.093164] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.093164] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-535" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.093472] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-9355679f-78b2-4e0d-815d-398d5c26292f taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.093680] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-9355679f-78b2-4e0d-815d-398d5c26292f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.093680] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-9355679f-78b2-4e0d-815d-398d5c26292f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.094089] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-9355679f-78b2-4e0d-815d-398d5c26292f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.094131] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9355679f-78b2-4e0d-815d-398d5c26292f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.193704] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.446374] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7: rpc.has_security_group_logging(os_id): False [ 630.454780] env[66364]: INFO networking_nsxv3.common.synchronization [None req-04d5b543-f79e-4003-993b-9d8af55800ff tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 630.454780] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 630.455029] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.455120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.455215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.455789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.455789] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.472039] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.472039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.473215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.473215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.473215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.473215] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.473215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.473215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.473215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.473215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.473215] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 is going to be created. [ 630.549339] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.549524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.549585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.549748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.549922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.563859] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 in Status: IN_PROGRESS for 2s [ 630.596612] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.596915] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.596962] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.597256] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.597403] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.597554] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 9355679f-78b2-4e0d-815d-398d5c26292f not found, creating... [ 630.597812] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.598044] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.598105] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.598302] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.598433] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.598701] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.598856] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.598963] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.599240] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.599401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.599670] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 9355679f-78b2-4e0d-815d-398d5c26292f is going to be created. [ 630.610326] env[66364]: INFO networking_nsxv3.common.synchronization [None req-25bd3ae5-b3ec-453f-b5cc-475a9c92eb9a tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 630.610875] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 630.611616] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.611761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.626186] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.626186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.626186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.626186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.626186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.626186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-9355679f-78b2-4e0d-815d-398d5c26292f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.697716] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.697911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.697961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.698191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.698286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.698384] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be created. [ 630.722443] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.722628] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.722699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.722909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.723081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.737582] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: UNINITIALIZED for 2s [ 630.976965] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.977266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.977266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.977482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.977574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.977775] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 already deleted. [ 630.978019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.978238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.978430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.978522] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.411937] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-2aaccb0c-0b13-48c1-9cfc-5da6ef266589 service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 631.412292] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-2aaccb0c-0b13-48c1-9cfc-5da6ef266589 service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 631.412292] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-2aaccb0c-0b13-48c1-9cfc-5da6ef266589 service nova] Enqueued Resource ID: 9355679f-78b2-4e0d-815d-398d5c26292f with Priority: HIGHEST for action port [ 631.412737] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 631.412899] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 631.412983] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9355679f-78b2-4e0d-815d-398d5c26292f with Priority: HIGHEST for action port [ 631.414152] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.414152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.414422] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.414422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.415752] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9355679f-78b2-4e0d-815d-398d5c26292f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.415752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9355679f-78b2-4e0d-815d-398d5c26292f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.415752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9355679f-78b2-4e0d-815d-398d5c26292f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.415752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9355679f-78b2-4e0d-815d-398d5c26292f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.415752] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9355679f-78b2-4e0d-815d-398d5c26292f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.500862] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.501315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.501315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.502028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.502028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.502028] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 already deleted. [ 631.502028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.918935] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9355679f-78b2-4e0d-815d-398d5c26292f with status ACTIVE [ 631.919272] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.919464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.919550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.919831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.919977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.920196] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.920348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.920435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.920616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.920692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.920921] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.921035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.921093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.921355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.921355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.921456] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9355679f-78b2-4e0d-815d-398d5c26292f is going to be updated. [ 631.948294] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.948510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.948641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.948900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.949084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.949340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9355679f-78b2-4e0d-815d-398d5c26292f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.332743] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.333023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-463" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.333145] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-463" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.333453] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-463" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.333827] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.334031] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.334153] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.334481] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.334684] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.334912] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.335041] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.335157] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.335269] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.335455] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.335606] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.335783] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.370291] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.370596] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.371620] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.371620] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-463" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.371620] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-13308981-3421-4971-891e-2baf62b9e6a4 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.371620] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-13308981-3421-4971-891e-2baf62b9e6a4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.372163] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-13308981-3421-4971-891e-2baf62b9e6a4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.372868] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-13308981-3421-4971-891e-2baf62b9e6a4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.373133] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13308981-3421-4971-891e-2baf62b9e6a4',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.579332] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 in Status: SUCCESS [ 632.579654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.750207] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 632.751038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.751038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.751038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.751354] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.751354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.751354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.751552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.751552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.751628] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.751733] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.752745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.752947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.753135] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.753248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.753312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.753536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.753536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.753651] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.876932] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.877185] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.877324] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.877581] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.877791] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.877976] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 13308981-3421-4971-891e-2baf62b9e6a4 not found, creating... [ 632.878250] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.878459] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.878589] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.878885] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.879064] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.879362] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.879603] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.879738] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.880344] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.880344] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.880344] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 13308981-3421-4971-891e-2baf62b9e6a4 is going to be created. [ 632.940241] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.940241] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.940241] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.940241] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.940241] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.940241] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-13308981-3421-4971-891e-2baf62b9e6a4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.256593] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.256942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.257040] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.647656] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-b744e27a-f919-44b2-924d-474b13f031b1 service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 633.647974] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-b744e27a-f919-44b2-924d-474b13f031b1 service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 633.648040] env[66364]: INFO networking_nsxv3.common.synchronization [req-247e4b46-c28d-4ffc-98c9-ce17291eb1bd req-b744e27a-f919-44b2-924d-474b13f031b1 service nova] Enqueued Resource ID: 13308981-3421-4971-891e-2baf62b9e6a4 with Priority: HIGHEST for action port [ 633.648621] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 633.648702] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 633.648792] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13308981-3421-4971-891e-2baf62b9e6a4 with Priority: HIGHEST for action port [ 633.649818] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.649999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.650311] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.650480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.650740] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-13308981-3421-4971-891e-2baf62b9e6a4 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.650893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13308981-3421-4971-891e-2baf62b9e6a4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.651039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13308981-3421-4971-891e-2baf62b9e6a4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.651327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13308981-3421-4971-891e-2baf62b9e6a4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.651477] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13308981-3421-4971-891e-2baf62b9e6a4',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.760104] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.153458] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13308981-3421-4971-891e-2baf62b9e6a4 with status ACTIVE [ 634.153738] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.153901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.153995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.155638] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.155638] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.155638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.155638] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13308981-3421-4971-891e-2baf62b9e6a4 is going to be updated. [ 634.181472] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.181684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.181728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.182207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.182207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.182418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13308981-3421-4971-891e-2baf62b9e6a4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.263024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.263228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.263278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.263504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.263685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.263862] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 634.307085] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.307279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.307331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.308051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.308232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.324280] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 634.706328] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-2e486cd5-0669-4acc-a7a3-a8968e07120c tempest-ListServersNegativeTestJSON-713481304 tempest-ListServersNegativeTestJSON-713481304-project-member] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 634.707616] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 634.707975] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.708741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.708741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.708741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.708741] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.709031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.709031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.709181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.709746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.709746] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.212843] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.212843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.212843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.212843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.212843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.213151] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.213151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.213151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.213368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.213421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.213511] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f already deleted. [ 635.213607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.216865] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.217653] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.217653] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.217653] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.217916] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.218197] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.218395] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.218563] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.218657] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.218979] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.219510] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.219701] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.219868] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.220045] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.220176] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.220359] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.247660] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.247840] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.247976] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.248145] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.248480] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-01b44ea9-ec2b-4278-b43e-6757420e8710 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.248763] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-01b44ea9-ec2b-4278-b43e-6757420e8710" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.248763] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-01b44ea9-ec2b-4278-b43e-6757420e8710" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.249144] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-01b44ea9-ec2b-4278-b43e-6757420e8710" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.249400] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01b44ea9-ec2b-4278-b43e-6757420e8710',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.755528] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.755528] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.755528] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.755528] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.755528] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.755528] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 01b44ea9-ec2b-4278-b43e-6757420e8710 not found, creating... [ 635.755528] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.755528] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.755528] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.756840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.756840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.757253] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.757253] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.757253] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.757453] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.757522] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.757703] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 01b44ea9-ec2b-4278-b43e-6757420e8710 is going to be created. [ 635.782502] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.783906] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.784054] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.784537] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.784809] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.785286] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-01b44ea9-ec2b-4278-b43e-6757420e8710" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.335823] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 636.336076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.336779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.337075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.337283] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.337458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.337458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.337650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.337740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.337827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.337998] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.339516] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.339618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.339759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.339921] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.340052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.340116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.340269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.340401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.340505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.340593] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.341707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.341793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.341934] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.342066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.342140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.342320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.342415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.342523] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.572447] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-eb04ec8c-9295-4f2c-ade1-9e33c588479e service nova] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_rules [ 636.572726] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-eb04ec8c-9295-4f2c-ade1-9e33c588479e service nova] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 636.572945] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-eb04ec8c-9295-4f2c-ade1-9e33c588479e service nova] Enqueued Resource ID: 01b44ea9-ec2b-4278-b43e-6757420e8710 with Priority: HIGHEST for action port [ 636.575049] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_rules [ 636.575160] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 636.575288] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b44ea9-ec2b-4278-b43e-6757420e8710 with Priority: HIGHEST for action port [ 636.575701] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.575900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.576018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.576336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.576436] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.577459] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.577869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.577937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.579348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.579348] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.579348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.579348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.579348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.579348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.579348] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.580502] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-01b44ea9-ec2b-4278-b43e-6757420e8710 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.580502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01b44ea9-ec2b-4278-b43e-6757420e8710" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.580502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01b44ea9-ec2b-4278-b43e-6757420e8710" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.580502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01b44ea9-ec2b-4278-b43e-6757420e8710" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.580502] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01b44ea9-ec2b-4278-b43e-6757420e8710',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.846554] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64957bc0-2496-43d3-8cbd-8653bab5f68b: rpc.has_security_group_logging(os_id): False [ 636.848311] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.872326] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.872599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.872599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.872788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.872870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.873091] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.873211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.873301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.873423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.873499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.873752] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.873856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.873919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.874114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.874186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.874374] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.874486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.874549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.874690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.874756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.874846] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be created. [ 636.886577] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba9ca7f9-2297-416a-8d3b-704ce0fe17be req-9c02b4c6-8993-4f90-abed-919507910725 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 636.886662] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba9ca7f9-2297-416a-8d3b-704ce0fe17be req-9c02b4c6-8993-4f90-abed-919507910725 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 636.887302] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 636.887410] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 636.887793] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.887961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.888069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.888296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.888450] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.888560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.888615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.888767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.888847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.888937] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.891481] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.891481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.891481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.891481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.891481] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.891481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.891481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.891481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.891481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.891896] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.941421] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.943023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.943023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.943023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.943023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.957032] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 636.963025] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba9ca7f9-2297-416a-8d3b-704ce0fe17be req-9c02b4c6-8993-4f90-abed-919507910725 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 636.963025] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba9ca7f9-2297-416a-8d3b-704ce0fe17be req-9c02b4c6-8993-4f90-abed-919507910725 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 636.963025] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba9ca7f9-2297-416a-8d3b-704ce0fe17be req-9c02b4c6-8993-4f90-abed-919507910725 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_rules [ 636.963025] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba9ca7f9-2297-416a-8d3b-704ce0fe17be req-9c02b4c6-8993-4f90-abed-919507910725 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 636.963025] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba9ca7f9-2297-416a-8d3b-704ce0fe17be req-9c02b4c6-8993-4f90-abed-919507910725 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 with Priority: HIGHEST for action port [ 636.963025] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 636.963025] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_rules [ 636.963025] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 with Priority: HIGHEST for action port [ 636.963916] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 636.964315] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 636.964952] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.965371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.965649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.966088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.966376] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.967797] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.968220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.968450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.975034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.975034] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.975034] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c892eb4d-67b2-4f13-8f8e-34fc30442df2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.975034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.975034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.975034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.975034] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c892eb4d-67b2-4f13-8f8e-34fc30442df2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.977324] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.977752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.978464] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.979665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.085524] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.085524] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.085524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.085524] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01b44ea9-ec2b-4278-b43e-6757420e8710 with status ACTIVE [ 637.085524] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.085524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.085524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.085524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.085524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.085524] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.086973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.087344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.093024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.093024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.093024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.093024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.093024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.093024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.093024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.093024] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01b44ea9-ec2b-4278-b43e-6757420e8710 is going to be updated. [ 637.127073] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.127073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.127073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.127073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.127073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.127073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01b44ea9-ec2b-4278-b43e-6757420e8710" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.351502] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.394167] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.395034] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.481280] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c892eb4d-67b2-4f13-8f8e-34fc30442df2 with status ACTIVE [ 637.481672] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.481860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.481966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.482338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.482473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.482746] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.482911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.483014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.483273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.483400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.483680] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.484191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.484191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.484441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.484441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.484547] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 is going to be updated. [ 637.486531] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.486531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.486834] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.486966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.513251] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.513251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.513251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.513251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.513251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.513251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.597485] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.753819] env[66364]: INFO networking_nsxv3.common.synchronization [req-1304b0d9-83b6-4d7d-afb7-333b1cecd8ad req-d1db9c79-ad40-4920-9124-39c1893cbf78 tempest-ServerDiagnosticsTest-1309587073 tempest-ServerDiagnosticsTest-1309587073-project-member] Enqueued Resource ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 with Priority: HIGHEST for action security_group_members [ 637.754301] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 with Priority: HIGHEST for action security_group_members [ 637.757098] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5165fdef-bf23-471f-87fc-3248cc2d9078 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.757098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.757098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.757098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.757098] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.757098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.757098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.757502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.757502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.757502] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5165fdef-bf23-471f-87fc-3248cc2d9078',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.853878] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.854221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.854221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.854399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.854493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.854770] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 637.896901] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.898815] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.920798] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.921015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.921095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.921447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.921557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.930867] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-7b0109d0-71b4-4c48-b36d-ca5bb4dbcc91 tempest-ListServersNegativeTestJSON-713481304 tempest-ListServersNegativeTestJSON-713481304-project-member] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 637.931314] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 637.931773] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.932445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.940342] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 638.099690] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.101050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.101050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.101050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.101050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.101050] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be created. [ 638.137075] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.137305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.137367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.137613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.137808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.149891] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: UNINITIALIZED for 2s [ 638.262039] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.262309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.262416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.263418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.263418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.263703] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.263876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.263876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.264134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.264241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.264577] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 is going to be updated. [ 638.332600] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.332808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.332808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.333058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.333205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.347726] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 in Status: IN_PROGRESS for 2s [ 638.397558] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.397785] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.397919] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.398208] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.398582] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.398734] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.398844] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.399990] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.399990] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.399990] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.399990] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.399990] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.399990] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.399990] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.399990] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.400321] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.401989] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.402934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.402934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.402934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.402934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.402934] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df21da4b-98ac-4bfa-b751-65483a460873 is going to be created. [ 638.403740] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.403846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.403918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.404088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.404170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.404257] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 638.433963] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.433963] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.433963] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.433963] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.434267] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-a81d6758-d07f-4ae3-9897-b1772729609e taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.434534] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-a81d6758-d07f-4ae3-9897-b1772729609e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.434717] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-a81d6758-d07f-4ae3-9897-b1772729609e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.435277] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-a81d6758-d07f-4ae3-9897-b1772729609e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.435477] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a81d6758-d07f-4ae3-9897-b1772729609e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.439483] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.439483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.439483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.439483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.439483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.450941] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: UNINITIALIZED for 2s [ 638.453620] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.453620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.453620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.453836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.454527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.465372] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 638.942538] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.942903] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.942903] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.943194] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.943346] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.943496] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port a81d6758-d07f-4ae3-9897-b1772729609e not found, creating... [ 638.944094] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.944268] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.944383] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.944634] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.944767] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.945082] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.945233] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.945428] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.945653] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.945781] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.945919] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: a81d6758-d07f-4ae3-9897-b1772729609e is going to be created. [ 638.969183] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.969404] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.969526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.969790] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.970016] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.970277] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-a81d6758-d07f-4ae3-9897-b1772729609e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.971820] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 638.972048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.972171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.972394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.972494] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.475342] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.475568] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.704776] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-fe394a5c-aa52-4e6e-a81b-15892c741260 service nova] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_rules [ 639.704776] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-fe394a5c-aa52-4e6e-a81b-15892c741260 service nova] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 639.704776] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-fe394a5c-aa52-4e6e-a81b-15892c741260 service nova] Enqueued Resource ID: a81d6758-d07f-4ae3-9897-b1772729609e with Priority: HIGHEST for action port [ 639.704776] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_rules [ 639.704776] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 639.704776] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81d6758-d07f-4ae3-9897-b1772729609e with Priority: HIGHEST for action port [ 639.704776] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.704776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.705355] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.705513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.705734] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-a81d6758-d07f-4ae3-9897-b1772729609e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.705890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a81d6758-d07f-4ae3-9897-b1772729609e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.705994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a81d6758-d07f-4ae3-9897-b1772729609e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.706262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a81d6758-d07f-4ae3-9897-b1772729609e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.706399] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a81d6758-d07f-4ae3-9897-b1772729609e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.952259] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 639.952538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.952743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.952922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.953124] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.953293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.953345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.953467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.953546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.953625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.953713] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.082102] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 640.082299] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 640.082430] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a with Priority: HIGHEST for action security_group_members [ 640.083633] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 640.083633] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 640.083724] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a with Priority: HIGHEST for action security_group_members [ 640.084088] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.084287] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.084476] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.084561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.084763] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1358a0-c55b-4cc7-8303-f2d79335b98a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.085261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.085261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.085570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.085734] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.086259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.086259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.086259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.086259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.086259] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.150337] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 640.150638] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 640.150785] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a with Priority: HIGHEST for action security_group_rules [ 640.150982] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a with Priority: HIGHEST for action security_group_members [ 640.151784] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_rules [ 640.151879] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 640.152088] env[66364]: INFO networking_nsxv3.common.synchronization [req-70e3a529-7212-4386-bd65-4991f3a0f949 req-ca0bd43e-709b-4059-8449-5bbf40a4dfcc tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 with Priority: HIGHEST for action port [ 640.153997] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 640.154184] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a with Priority: HIGHEST for action security_group_rules [ 640.154310] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 640.154447] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 with Priority: HIGHEST for action port [ 640.154488] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_rules [ 640.154845] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 640.155008] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a with Priority: HIGHEST for action security_group_members [ 640.155893] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.156049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.156309] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb1358a0-c55b-4cc7-8303-f2d79335b98a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.156451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.156522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.156816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.156919] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.158228] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.158228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.158440] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c892eb4d-67b2-4f13-8f8e-34fc30442df2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.158557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.158702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.158923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.159033] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c892eb4d-67b2-4f13-8f8e-34fc30442df2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.159949] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.160310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.160310] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.160401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.160543] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1358a0-c55b-4cc7-8303-f2d79335b98a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.160780] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.171738] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 640.172290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.172405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.172668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.172903] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.173211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.173211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.173336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.173512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.173570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.174041] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.175932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.176179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.176393] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.176517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.176603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.177123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.177123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.177123] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.209765] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a81d6758-d07f-4ae3-9897-b1772729609e with status ACTIVE [ 640.210144] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.210342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.210443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.210762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.210884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.211172] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.211415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.211507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.211750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.212817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.212817] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.212817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.212817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.212817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.212817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.213407] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a81d6758-d07f-4ae3-9897-b1772729609e is going to be updated. [ 640.237259] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.240021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.240021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.240021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.240021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.240021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a81d6758-d07f-4ae3-9897-b1772729609e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.279633] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-28ad76fc-2753-426f-ac22-8227d830b3fa tempest-ListServersNegativeTestJSON-713481304 tempest-ListServersNegativeTestJSON-713481304-project-member] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 640.280212] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 640.280524] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.280631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.358045] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 in Status: SUCCESS [ 640.359363] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5165fdef-bf23-471f-87fc-3248cc2d9078 deletion is rescheduled due to dependency. [ 640.359363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5165fdef-bf23-471f-87fc-3248cc2d9078" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.455949] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.456150] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.456231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.456473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.456654] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.456745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.456887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.456991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.457081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.457181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.457333] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.457459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.457526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.457680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.457854] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.457947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.457997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.458166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.458254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.458336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.458422] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.461661] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: SUCCESS [ 640.461960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.462075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.462267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.462379] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.462499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.462565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.462713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.463463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.463463] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.477578] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 640.477992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.477992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.478307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.478400] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.478514] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.478629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.478830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.478830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.478981] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.588484] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.661719] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1358a0-c55b-4cc7-8303-f2d79335b98a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.662112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.663347] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c892eb4d-67b2-4f13-8f8e-34fc30442df2 with status ACTIVE [ 640.663638] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.663812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.664045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.664186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.664278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.664618] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.664751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.664849] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.664995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.665104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.665264] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.665404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.665404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.666202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.666202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.666202] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c892eb4d-67b2-4f13-8f8e-34fc30442df2 is going to be updated. [ 640.685639] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.685639] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.685639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.692521] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.692521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.692521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.692521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.692521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.692521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c892eb4d-67b2-4f13-8f8e-34fc30442df2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.699703] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.699881] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.699993] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.700289] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.700619] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.700791] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.702342] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.702342] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.702342] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.702342] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.702342] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.702342] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.702342] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.702342] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.702342] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.702916] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.722174] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.722380] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.722621] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.722821] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-871" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.723161] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-dcda2036-e474-4467-a49c-a9c7e7206c0a taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.723331] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-dcda2036-e474-4467-a49c-a9c7e7206c0a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.723445] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-dcda2036-e474-4467-a49c-a9c7e7206c0a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.723762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-dcda2036-e474-4467-a49c-a9c7e7206c0a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.723891] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcda2036-e474-4467-a49c-a9c7e7206c0a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.960549] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64957bc0-2496-43d3-8cbd-8653bab5f68b: rpc.has_security_group_logging(os_id): False [ 640.964892] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.981436] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.981436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.981436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.981436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.981436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.981436] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.981436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.981436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.981794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.981794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.982057] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.982214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.982355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.982678] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.982902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.983426] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.983713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.983828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.983905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.984422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.984422] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 640.985713] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.066640] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.066803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.066873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.067126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.067279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.080848] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 641.091524] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.188284] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.226740] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.226994] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.227120] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.227407] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.227558] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.227839] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port dcda2036-e474-4467-a49c-a9c7e7206c0a not found, creating... [ 641.228282] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.228554] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.228690] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.229184] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.229333] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.229619] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.229768] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.229878] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.230160] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.230302] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.230440] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: dcda2036-e474-4467-a49c-a9c7e7206c0a is going to be created. [ 641.258022] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.258022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.258022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.258022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.258022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.258022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-dcda2036-e474-4467-a49c-a9c7e7206c0a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.468692] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.488209] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.594430] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.594625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.594697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.594930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.595046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.595163] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a is going to be created. [ 641.621663] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.621929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.622014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.622329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.622524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.636029] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a in Status: UNINITIALIZED for 2s [ 641.691633] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.691633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.691633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.691953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.691953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.692061] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be updated. [ 641.721692] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.721878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.721954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.722191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.722343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.736340] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 641.970981] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.971436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.971486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.971837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.971837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.971964] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df21da4b-98ac-4bfa-b751-65483a460873 is going to be updated. [ 641.990909] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.991156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.991374] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.991585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.991710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.991876] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 641.998637] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-020f71aa-aa63-4f83-9093-5086c9b748b5 service nova] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_rules [ 641.999618] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-020f71aa-aa63-4f83-9093-5086c9b748b5 service nova] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 642.000153] env[66364]: INFO networking_nsxv3.common.synchronization [req-4ba81a93-71e2-4fa8-9afc-95e1369cff6a req-020f71aa-aa63-4f83-9093-5086c9b748b5 service nova] Enqueued Resource ID: dcda2036-e474-4467-a49c-a9c7e7206c0a with Priority: HIGHEST for action port [ 642.001247] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_rules [ 642.002134] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 642.002403] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcda2036-e474-4467-a49c-a9c7e7206c0a with Priority: HIGHEST for action port [ 642.003074] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.003322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.003731] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.003955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.004960] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcda2036-e474-4467-a49c-a9c7e7206c0a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.005225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcda2036-e474-4467-a49c-a9c7e7206c0a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.005562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcda2036-e474-4467-a49c-a9c7e7206c0a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.006532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcda2036-e474-4467-a49c-a9c7e7206c0a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.006532] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcda2036-e474-4467-a49c-a9c7e7206c0a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.024810] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.025113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.025113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.025306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.025474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.042049] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: IN_PROGRESS for 2s [ 642.046313] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.046495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.046542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.046755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.046904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.058160] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 642.509853] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcda2036-e474-4467-a49c-a9c7e7206c0a with status ACTIVE [ 642.510147] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.510318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.510478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.510643] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.510739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.510921] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.511063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.511128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.511401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.511445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.511618] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.511713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.511770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.511917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.511989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.512081] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcda2036-e474-4467-a49c-a9c7e7206c0a is going to be updated. [ 642.557020] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.557205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.557314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.557475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.558054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.558054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcda2036-e474-4467-a49c-a9c7e7206c0a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.793995] env[66364]: INFO networking_nsxv3.common.synchronization [req-e34afa18-349d-4d5e-8f9c-40a2197a13b6 req-44e22afd-94b1-4ff1-8f26-868d1fea1626 tempest-ServersTestBootFromVolume-733094098 tempest-ServersTestBootFromVolume-733094098-project-member] Enqueued Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_members [ 642.794529] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_members [ 642.794920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-02c59c8a-da67-420a-8de3-ef613658b83d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.795080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.795153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.795496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.795696] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.795817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.795885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.796119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.796220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.796301] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.100339] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 643.100339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.100339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.100339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.100339] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.299649] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.300134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.300134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.300134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.300519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.300519] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.300519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.300759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.300759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.300835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.300884] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02c59c8a-da67-420a-8de3-ef613658b83d already deleted. [ 643.300991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.326874] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.326874] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-305" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.326874] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-305" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.326874] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-305" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.327671] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.327671] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.327671] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.327671] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.327671] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.327927] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.327927] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.328038] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.328510] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.328510] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.328510] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.328510] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.350546] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.350768] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.350916] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.351080] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-305" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.351534] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-9d33b242-0b61-440b-9566-34a175b6629f taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.351706] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-9d33b242-0b61-440b-9566-34a175b6629f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.351857] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-9d33b242-0b61-440b-9566-34a175b6629f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.352785] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-9d33b242-0b61-440b-9566-34a175b6629f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.352920] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d33b242-0b61-440b-9566-34a175b6629f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.602953] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.603173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.603243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.603465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.603707] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.603916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.603980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.604158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.604246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.604338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.604455] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.646469] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a in Status: SUCCESS [ 643.646803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.647044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.647304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.647532] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.647715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.647859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.648053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.648140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.648240] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.745652] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 643.745894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.746084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.746312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.746503] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.746618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.746718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.746833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.746913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.747016] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.857286] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.857286] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.857286] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.857676] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.857844] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.858021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 9d33b242-0b61-440b-9566-34a175b6629f not found, creating... [ 643.858437] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.858628] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.858765] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.859055] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.859234] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.859671] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.859815] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.859960] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.860360] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.860360] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.861116] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 9d33b242-0b61-440b-9566-34a175b6629f is going to be created. [ 643.890798] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.891043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.891168] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.891660] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.891876] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.892121] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-9d33b242-0b61-440b-9566-34a175b6629f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.054955] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: SUCCESS [ 644.055224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.055508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.055809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.056151] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.056282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.056378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.056673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.056810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.056956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.057315] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.058428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.058746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.058954] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.059091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.059153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.059337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.059444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.059540] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.075027] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 644.075167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.078266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.078266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.078266] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.078266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.078266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.078266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.078266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.078266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.078787] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.083367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.083367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.083367] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.083367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.083367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.083367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.083367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.083367] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.109047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.109047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.109047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.109047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.110258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.110258] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.110258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.110258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.110258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.110258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.110258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.110258] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.151957] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.249405] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.564017] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.565102] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.585665] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.585875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.586148] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.616323] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64957bc0-2496-43d3-8cbd-8653bab5f68b: rpc.has_security_group_logging(os_id): False [ 644.652738] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.652967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.652967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.653545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.653545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.653545] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.653793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.653793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.654090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.654090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.654345] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.654474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.654576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.655283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.655283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.655283] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.655283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.655565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.655565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.655565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.655671] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 644.656962] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.705623] env[66364]: INFO networking_nsxv3.common.synchronization [req-e34afa18-349d-4d5e-8f9c-40a2197a13b6 req-dd4001df-0d13-4e72-b14b-0ee84f762004 service nova] Enqueued Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_rules [ 644.705780] env[66364]: INFO networking_nsxv3.common.synchronization [req-e34afa18-349d-4d5e-8f9c-40a2197a13b6 req-dd4001df-0d13-4e72-b14b-0ee84f762004 service nova] Enqueued Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_members [ 644.705841] env[66364]: INFO networking_nsxv3.common.synchronization [req-e34afa18-349d-4d5e-8f9c-40a2197a13b6 req-dd4001df-0d13-4e72-b14b-0ee84f762004 service nova] Enqueued Resource ID: 9d33b242-0b61-440b-9566-34a175b6629f with Priority: HIGHEST for action port [ 644.706970] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_rules [ 644.706970] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_members [ 644.706970] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d33b242-0b61-440b-9566-34a175b6629f with Priority: HIGHEST for action port [ 644.706970] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02c59c8a-da67-420a-8de3-ef613658b83d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.707414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.707480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.707689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.707764] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.708746] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-02c59c8a-da67-420a-8de3-ef613658b83d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.708746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.708954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.708994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.709587] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.709587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.709587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.709587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.709587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.709941] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.711513] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d33b242-0b61-440b-9566-34a175b6629f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.711513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d33b242-0b61-440b-9566-34a175b6629f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.711513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d33b242-0b61-440b-9566-34a175b6629f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.711513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d33b242-0b61-440b-9566-34a175b6629f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.711513] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d33b242-0b61-440b-9566-34a175b6629f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.728229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.728776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.728855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.729664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.729664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.749098] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 644.753798] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.068852] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df21da4b-98ac-4bfa-b751-65483a460873: rpc.has_security_group_logging(os_id): False [ 645.070719] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.091178] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.091367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.091461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.091711] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.091817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.092078] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.092176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.092246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.092362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.092439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.092523] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df21da4b-98ac-4bfa-b751-65483a460873 is going to be created. [ 645.093909] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.160350] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.160722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.160722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.160802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.160845] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.160966] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a is going to be updated. [ 645.167476] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.167476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.167476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.167476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.167675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.187211] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: IN_PROGRESS for 2s [ 645.196566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.196566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.196758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.196860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.197069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.210092] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a in Status: IN_PROGRESS for 2s [ 645.215157] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-02c59c8a-da67-420a-8de3-ef613658b83d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.215300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.215469] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.219227] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d33b242-0b61-440b-9566-34a175b6629f with status ACTIVE [ 645.219227] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.219227] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.219227] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.219227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.219227] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d33b242-0b61-440b-9566-34a175b6629f is going to be updated. [ 645.249207] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.249368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.249439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.249658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.249794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.249954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d33b242-0b61-440b-9566-34a175b6629f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.258116] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.258533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.258533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.258646] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.258683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.258781] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be updated. [ 645.337886] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.338263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.338378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.338616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.338769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.351147] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 645.574400] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.574400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.574400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.574400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.574718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.574718] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df21da4b-98ac-4bfa-b751-65483a460873 is going to be updated. [ 645.597363] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.598323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.599439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.599827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.599827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.599929] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 645.619973] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.620202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.620202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.620349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.620675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.643161] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: IN_PROGRESS for 2s [ 645.647810] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.648024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.648112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.648249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.648850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.659035] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 645.722515] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.226936] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.227283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.227898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.228252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.228357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.228505] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02c59c8a-da67-420a-8de3-ef613658b83d is going to be created. [ 646.260942] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.260942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.261148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.261255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.261537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.283198] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02c59c8a-da67-420a-8de3-ef613658b83d in Status: UNINITIALIZED for 2s [ 646.429765] env[66364]: INFO networking_nsxv3.common.synchronization [req-23a1b8fe-89f0-47f0-9eb6-3865f81e13d6 req-eabb44ed-57b4-4140-b2f4-7997ba3c4956 tempest-VolumesAdminNegativeTest-96897597 tempest-VolumesAdminNegativeTest-96897597-project-member] Enqueued Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGHEST for action security_group_members [ 646.431510] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGHEST for action security_group_members [ 646.432278] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9dde915-fa65-4509-8423-f46e62870074 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.432451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.432611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.434016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.434204] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.434353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.434471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.435018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.435018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.435168] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9dde915-fa65-4509-8423-f46e62870074',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.767785] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 646.767934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.941723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.941891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.941939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.942186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.942281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.942561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.942653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.942690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.942860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.942936] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.943032] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9dde915-fa65-4509-8423-f46e62870074 is going to be updated. [ 646.973255] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.973409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.973478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.973713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.973978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.989078] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9dde915-fa65-4509-8423-f46e62870074 in Status: IN_PROGRESS for 2s [ 647.204463] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: SUCCESS [ 647.204740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.204839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.205220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.205220] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.224816] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a in Status: SUCCESS [ 647.225077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.225270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.225573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.225682] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.225890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.225890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.226033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.226092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.226175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.226590] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.365992] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 647.366591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.367777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.367777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.367777] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.368157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.369041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.369292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.369700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.369700] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.653560] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: SUCCESS [ 647.653876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.654239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.654612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.655042] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.655227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.655328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.655630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.655767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.655913] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.669637] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 647.669857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.670360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.670606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.670890] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.671471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.671471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.671471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.671639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.671639] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.708538] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.708731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.733707] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.872161] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.159488] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.177451] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.236594] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb1358a0-c55b-4cc7-8303-f2d79335b98a: rpc.has_security_group_logging(os_id): False [ 648.262456] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.262680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.262680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.262923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.263024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.263278] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.263412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.263484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.263686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.263774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.263907] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a is going to be created. [ 648.297874] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02c59c8a-da67-420a-8de3-ef613658b83d in Status: SUCCESS [ 648.297874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.297874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.297874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.297874] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.297874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.297874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.297874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.297874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.297874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.297874] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.346779] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.347043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.347086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.347424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.348028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.364121] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a in Status: IN_PROGRESS for 2s [ 648.378313] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.663752] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.679781] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.804437] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.880727] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.883378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.883378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.883378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.883378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.883378] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be updated. [ 648.922041] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.922041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.922234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.922379] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.922567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.942787] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 649.000396] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9dde915-fa65-4509-8423-f46e62870074 in Status: SUCCESS [ 649.000650] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9dde915-fa65-4509-8423-f46e62870074 deletion is rescheduled due to dependency. [ 649.000773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.167862] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.168200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.168294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.168495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.168592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.168716] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df21da4b-98ac-4bfa-b751-65483a460873 is going to be updated. [ 649.182487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.182729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.182729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.183236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.183236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.183236] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 649.212165] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.212357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.212477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.212716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.213873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.215335] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.215593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.215695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.215919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.216442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.231618] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: IN_PROGRESS for 2s [ 649.233328] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 649.310075] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02c59c8a-da67-420a-8de3-ef613658b83d: rpc.has_security_group_logging(os_id): False [ 649.342025] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.342025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.342025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.342025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.342025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.342025] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.342025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.342025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.342025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.342025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.342025] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02c59c8a-da67-420a-8de3-ef613658b83d is going to be created. [ 649.438087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.438503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.438503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.438657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.440021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.455597] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02c59c8a-da67-420a-8de3-ef613658b83d in Status: IN_PROGRESS for 2s [ 650.380533] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a in Status: SUCCESS [ 650.380818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.630115] env[66364]: INFO networking_nsxv3.common.synchronization [req-61918f4c-8dd3-4874-b8ee-7d04b4faf276 req-1d68cc73-6160-4170-8012-168b25735fe6 tempest-FloatingIPsAssociationNegativeTestJSON-1552793735 tempest-FloatingIPsAssociationNegativeTestJSON-1552793735-project-member] Enqueued Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGHEST for action security_group_members [ 650.631092] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGHEST for action security_group_members [ 650.632453] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b09036d-f422-41d0-af9e-74fbcbfb71a6 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.633259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.633259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.633565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.633753] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.633858] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.633918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.634110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.634200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.634311] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b09036d-f422-41d0-af9e-74fbcbfb71a6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.954729] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 650.954978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.957920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.957920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.957920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.958539] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.958539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.958539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.958539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.958539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.958719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.958719] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.959570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.959735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.959907] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.962828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.962828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.962828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.962828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.962828] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.131468] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-33 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.131738] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-33" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.131907] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-33" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.132282] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-33" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.132580] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.132826] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.132929] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.133233] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.133382] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.133596] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.133700] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.133799] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.133900] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.134016] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.134120] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.134247] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.136752] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.136752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.137090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.137090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.137090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.137816] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.137816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.137816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.137816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.137816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.137816] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 already deleted. [ 651.138159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.159230] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.159468] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 651.160299] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.160862] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-33" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.161294] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.161564] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.161737] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.162473] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.162671] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.242887] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 651.243245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.244696] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: SUCCESS [ 651.245133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.245399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.245881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.245881] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.246105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.246105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.246336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.246396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.246576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.246679] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.247188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.247188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.247290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.247447] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.247961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.248038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.248232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.248294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.248423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.248483] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.251999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.251999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.251999] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.251999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.251999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.251999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.251999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.251999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.251999] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.464065] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5467face-590a-4281-b5c2-cf02d5a2e65f: rpc.has_security_group_logging(os_id): False [ 651.465467] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.469197] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02c59c8a-da67-420a-8de3-ef613658b83d in Status: SUCCESS [ 651.471781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.486089] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.486267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.487344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.487344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.487344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.487344] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.487344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.487344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.487344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.487344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.487344] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.488761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.488761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.488761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.488761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.488761] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.488761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.488761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.488761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.488761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.488761] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be created. [ 651.549180] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.549529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.549633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.549831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.550056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.565131] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 651.665500] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.666161] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.666161] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.666161] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.666361] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.666467] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed not found, creating... [ 651.667064] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.667064] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.667064] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.667265] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.667355] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.667633] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.667785] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.667897] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.668143] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.668276] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.668431] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed is going to be created. [ 651.699210] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.699481] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.699595] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.699871] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.700107] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.700329] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.753469] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.754479] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0ef17dd-12b4-4751-91bb-321b509b882e: rpc.has_security_group_logging(os_id): False [ 651.773163] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.773163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.773163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.773331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.774950] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.774950] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.774950] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.774950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.775602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.775602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.775602] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 651.873361] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.873635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.873635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.873876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.874061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.897785] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 651.969958] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.257836] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df21da4b-98ac-4bfa-b751-65483a460873: rpc.has_security_group_logging(os_id): False [ 652.280035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.280035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.280035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.280035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.280035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.280035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.280035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.280035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.280035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.280035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.280035] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df21da4b-98ac-4bfa-b751-65483a460873 is going to be updated. [ 652.355473] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.355685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.355822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.355972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.356134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.372144] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: IN_PROGRESS for 2s [ 652.438576] env[66364]: INFO networking_nsxv3.common.synchronization [req-61918f4c-8dd3-4874-b8ee-7d04b4faf276 req-73e1e67f-be69-4d9a-bfd3-a376fc740653 service nova] Enqueued Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGHEST for action security_group_rules [ 652.438822] env[66364]: INFO networking_nsxv3.common.synchronization [req-61918f4c-8dd3-4874-b8ee-7d04b4faf276 req-73e1e67f-be69-4d9a-bfd3-a376fc740653 service nova] Enqueued Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGHEST for action security_group_members [ 652.438907] env[66364]: INFO networking_nsxv3.common.synchronization [req-61918f4c-8dd3-4874-b8ee-7d04b4faf276 req-73e1e67f-be69-4d9a-bfd3-a376fc740653 service nova] Enqueued Resource ID: 3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed with Priority: HIGHEST for action port [ 652.443787] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGHEST for action security_group_rules [ 652.444056] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGHEST for action security_group_members [ 652.444184] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed with Priority: HIGHEST for action port [ 652.444548] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.444779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.444821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.445779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.445779] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b09036d-f422-41d0-af9e-74fbcbfb71a6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.450668] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b09036d-f422-41d0-af9e-74fbcbfb71a6 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.450668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.450988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.451173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.451360] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.451560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.451629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.451830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.451947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.452064] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b09036d-f422-41d0-af9e-74fbcbfb71a6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.453121] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.453352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.453352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.454168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.454168] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.473099] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.473099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.474257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.474401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.474401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.474580] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be updated. [ 652.515335] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.515740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.515740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.515740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.516159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.527630] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 652.841191] env[66364]: INFO networking_nsxv3.common.synchronization [None req-27b56528-0eb7-4694-b2ac-3f211f8a3df6 None None] Enqueued Resource ID: c6cc6fe7-7d22-4688-b19e-fc52fddd588f with Priority: HIGHEST for action port [ 652.841851] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6cc6fe7-7d22-4688-b19e-fc52fddd588f with Priority: HIGHEST for action port [ 652.842649] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6cc6fe7-7d22-4688-b19e-fc52fddd588f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.842806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6cc6fe7-7d22-4688-b19e-fc52fddd588f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.842874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6cc6fe7-7d22-4688-b19e-fc52fddd588f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.843133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6cc6fe7-7d22-4688-b19e-fc52fddd588f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.843254] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6cc6fe7-7d22-4688-b19e-fc52fddd588f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.951145] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b09036d-f422-41d0-af9e-74fbcbfb71a6 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.951284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.956112] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b09036d-f422-41d0-af9e-74fbcbfb71a6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.957319] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed with status ACTIVE [ 652.957775] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.958886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.958886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.958886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.958886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.958886] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.958886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.959240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.959240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.959240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.961679] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.961679] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.961679] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.961679] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.961679] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.961679] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed is going to be updated. [ 652.993983] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.994238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.994238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.994321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.994484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.994613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3baa0d4b-84aa-40b1-9a5f-b8f054b3a3ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.345930] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6cc6fe7-7d22-4688-b19e-fc52fddd588f [ 653.345930] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.345930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.345930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.345930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.345930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.345930] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6cc6fe7-7d22-4688-b19e-fc52fddd588f already deleted. [ 653.346498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6cc6fe7-7d22-4688-b19e-fc52fddd588f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.462942] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b09036d-f422-41d0-af9e-74fbcbfb71a6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.579460] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 653.579754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.579970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.580280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.580406] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.695451] env[66364]: INFO networking_nsxv3.common.synchronization [req-c1356a30-b33a-4d54-905b-9a58e6222039 req-cae46226-7235-4913-8d1a-de1f412e762e tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 653.695983] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 653.696299] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.696425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.696494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.697150] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.697309] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.697416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.697481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.697639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.697726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.697817] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.911204] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 653.911204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.911204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.911607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.911607] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.966758] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.967838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.967998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.968348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.968498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.968655] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 is going to be created. [ 654.002227] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.002425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.002535] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.002764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.002935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.013025] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 in Status: UNINITIALIZED for 2s [ 654.084043] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.084043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.113620] env[66364]: INFO networking_nsxv3.common.synchronization [req-9292e26b-bbe1-4a0d-9b17-e8724fe26cb0 req-033466fa-e627-4ca0-a834-5d6e95ed2e0f tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 654.113620] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 654.113620] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.113620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.113620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.113620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.114203] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.114203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.114203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.114434] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.114549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.114650] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.200888] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.200888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.200888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.200888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.200888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.201262] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.201262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.201262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.201262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.201444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.201444] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 654.233276] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.233519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.233519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.233785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.233886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.243780] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 654.329929] env[66364]: INFO networking_nsxv3.common.synchronization [None req-1ca89bab-ae48-4ebe-8468-aa8be1f349f1 None None] Enqueued Resource ID: a7e787fb-9026-4de2-8279-1fc7a93173a0 with Priority: HIGHEST for action port [ 654.330474] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7e787fb-9026-4de2-8279-1fc7a93173a0 with Priority: HIGHEST for action port [ 654.330787] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7e787fb-9026-4de2-8279-1fc7a93173a0 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.330906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7e787fb-9026-4de2-8279-1fc7a93173a0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.330967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7e787fb-9026-4de2-8279-1fc7a93173a0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.331354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7e787fb-9026-4de2-8279-1fc7a93173a0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.331466] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7e787fb-9026-4de2-8279-1fc7a93173a0',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.386785] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: SUCCESS [ 654.387063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.391728] env[66364]: INFO networking_nsxv3.common.synchronization [req-0af35448-c9bc-4e13-bba4-e20d56b12523 req-9dadc573-f8d3-4e5c-85af-58cb19842e06 tempest-ServersWithSpecificFlavorTestJSON-596773426 tempest-ServersWithSpecificFlavorTestJSON-596773426-project-member] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 654.392355] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 654.392765] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.392873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.392922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.393625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.393845] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.393993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.394129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.394361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.394689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.394689] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.416740] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.416943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.416943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.417277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.417498] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.417615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.417687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.417870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.418038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.418212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.418682] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.539626] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 654.539839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.540011] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.540724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.540724] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.540724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.540724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.540968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.540968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.540968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.541116] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.618304] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.698891] env[66364]: INFO networking_nsxv3.common.synchronization [req-9292e26b-bbe1-4a0d-9b17-e8724fe26cb0 req-28a00170-041a-49f8-b535-6eb1c61715cb tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 654.699629] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 654.700791] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.700791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.735231] env[66364]: INFO networking_nsxv3.common.synchronization [None req-918befe5-d1e7-4a9e-84ed-3f5dbcda0886 None None] Enqueued Resource ID: 7327f1d4-942c-4dce-af76-c2e3b27ebc10 with Priority: HIGHEST for action port [ 654.735231] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7327f1d4-942c-4dce-af76-c2e3b27ebc10 with Priority: HIGHEST for action port [ 654.735231] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7327f1d4-942c-4dce-af76-c2e3b27ebc10 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.735231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7327f1d4-942c-4dce-af76-c2e3b27ebc10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.735231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7327f1d4-942c-4dce-af76-c2e3b27ebc10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.735978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7327f1d4-942c-4dce-af76-c2e3b27ebc10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.736276] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7327f1d4-942c-4dce-af76-c2e3b27ebc10',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.833523] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7e787fb-9026-4de2-8279-1fc7a93173a0 [ 654.833806] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.833961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.834033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.834245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.834335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.834425] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7e787fb-9026-4de2-8279-1fc7a93173a0 already deleted. [ 654.834505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7e787fb-9026-4de2-8279-1fc7a93173a0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.896822] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.896985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.897088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.897641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.897766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.897944] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.898635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.898635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.898635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.898635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.898635] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37506c58-083d-46d9-8010-be6545a2e954 already deleted. [ 654.898635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.920462] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.920462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.920848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.920848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.920974] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.921086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.921151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.921336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.921483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.921592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.921747] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.921897] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.921988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.922207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.922355] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.922462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.922556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.922704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.923838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.923838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.923838] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.972627] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-448 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.972627] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-448" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.972627] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-448" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.972627] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-448" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.972627] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.972627] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.972627] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.972627] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.973222] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.973222] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.973222] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.973363] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.973460] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.973566] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.973663] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.973814] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.995866] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.996100] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.996281] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.996873] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-448" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.996873] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-5d60b333-758e-4ad4-8362-fbd96e7131c1 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.997081] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-5d60b333-758e-4ad4-8362-fbd96e7131c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.997125] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-5d60b333-758e-4ad4-8362-fbd96e7131c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.997438] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-5d60b333-758e-4ad4-8362-fbd96e7131c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.997598] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d60b333-758e-4ad4-8362-fbd96e7131c1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.045514] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.045721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.045771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.049021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.049021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.049021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.049021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.049021] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.121626] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.239460] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7327f1d4-942c-4dce-af76-c2e3b27ebc10 [ 655.239735] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.240048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.240048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.240465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.240465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.240465] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7327f1d4-942c-4dce-af76-c2e3b27ebc10 already deleted. [ 655.240465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7327f1d4-942c-4dce-af76-c2e3b27ebc10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.309971] env[66364]: INFO networking_nsxv3.common.synchronization [req-9292e26b-bbe1-4a0d-9b17-e8724fe26cb0 req-4688cacf-0483-4e57-8f22-c19908a86e1a tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 655.310630] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 655.310964] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.311097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.425667] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0ef17dd-12b4-4751-91bb-321b509b882e: rpc.has_security_group_logging(os_id): False [ 655.449860] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.450057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.450105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.450301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.450380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.450564] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.450670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.450743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.450885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.452069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.452069] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.452069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.452069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.452069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.452069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.452069] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.452069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.452069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.452069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.452666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.452666] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 655.500401] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.500632] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.500724] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.501053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.501207] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.502285] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 5d60b333-758e-4ad4-8362-fbd96e7131c1 not found, creating... [ 655.502285] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.502285] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.502285] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.502285] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.502285] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.502641] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.502641] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.502737] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.502992] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.504444] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.504696] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 5d60b333-758e-4ad4-8362-fbd96e7131c1 is going to be created. [ 655.525897] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.526062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.526137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.526345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.526494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.528597] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.528854] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.528937] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.529383] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.529627] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.529867] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-5d60b333-758e-4ad4-8362-fbd96e7131c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.550801] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 655.550801] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5467face-590a-4281-b5c2-cf02d5a2e65f: rpc.has_security_group_logging(os_id): False [ 655.577215] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.578218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.578218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.578218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.578218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.578218] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.578218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.578218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.578218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.578573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.578573] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.578573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.578682] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.578784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.578830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.579685] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.579822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.579909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.580137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.580137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.580307] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be updated. [ 655.624920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.625122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.625193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.626725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.626725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.626725] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 655.724203] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.724503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.724636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.724972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.725238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.734708] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.735243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.735373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.735671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.735875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.740549] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 655.760465] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 656.023185] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 in Status: SUCCESS [ 656.023520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.023582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.023878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.023981] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.024122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.024188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.024354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.024440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.024525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.024637] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b09036d-f422-41d0-af9e-74fbcbfb71a6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.267880] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 656.268710] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 deletion is rescheduled due to dependency. [ 656.268710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.329928] env[66364]: INFO networking_nsxv3.common.synchronization [req-0af35448-c9bc-4e13-bba4-e20d56b12523 req-e6959481-3e17-47ae-91dc-951b0e2083ca service nova] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_rules [ 656.329928] env[66364]: INFO networking_nsxv3.common.synchronization [req-0af35448-c9bc-4e13-bba4-e20d56b12523 req-e6959481-3e17-47ae-91dc-951b0e2083ca service nova] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 656.329928] env[66364]: INFO networking_nsxv3.common.synchronization [req-0af35448-c9bc-4e13-bba4-e20d56b12523 req-e6959481-3e17-47ae-91dc-951b0e2083ca service nova] Enqueued Resource ID: 5d60b333-758e-4ad4-8362-fbd96e7131c1 with Priority: HIGHEST for action port [ 656.330421] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_rules [ 656.330555] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 656.330730] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d60b333-758e-4ad4-8362-fbd96e7131c1 with Priority: HIGHEST for action port [ 656.330912] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.331821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.331925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.332158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.332246] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.333495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.335699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.335797] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.336013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.336181] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.336286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.336486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.336486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.336590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.336680] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.337554] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d60b333-758e-4ad4-8362-fbd96e7131c1 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.337670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d60b333-758e-4ad4-8362-fbd96e7131c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.337737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d60b333-758e-4ad4-8362-fbd96e7131c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.338091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d60b333-758e-4ad4-8362-fbd96e7131c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.338091] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d60b333-758e-4ad4-8362-fbd96e7131c1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.528173] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b09036d-f422-41d0-af9e-74fbcbfb71a6 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.528345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.528456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.529738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.529738] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.529738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.529738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.529738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.529738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.529738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.529738] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b09036d-f422-41d0-af9e-74fbcbfb71a6 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.529738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.529738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.530266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.530266] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.530266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.530382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.530762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.530762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.530762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.532023] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b09036d-f422-41d0-af9e-74fbcbfb71a6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.844872] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.844872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.844872] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.845803] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d60b333-758e-4ad4-8362-fbd96e7131c1 with status ACTIVE [ 656.846014] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.846190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.846245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.846498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.846556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.846707] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.846839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.846900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.847081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.847157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.847331] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.847419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.847484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.847620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.847689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.847766] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d60b333-758e-4ad4-8362-fbd96e7131c1 is going to be updated. [ 656.869076] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.871041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.871041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.871041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.871041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.871041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d60b333-758e-4ad4-8362-fbd96e7131c1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.976379] env[66364]: INFO networking_nsxv3.common.synchronization [req-254fd78e-efa1-49cb-a350-d424ebf9a92b req-475b8133-111a-42d4-a9e9-20f74f64ad8f tempest-TenantUsagesTestJSON-1756635530 tempest-TenantUsagesTestJSON-1756635530-project-member] Enqueued Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGHEST for action security_group_members [ 656.976379] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGHEST for action security_group_members [ 656.977518] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-19e02b7c-5738-40ef-bfaa-0d499061b1d5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.977880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.978113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.978561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.979471] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.979700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.980335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.980657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.980935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.981145] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19e02b7c-5738-40ef-bfaa-0d499061b1d5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.036109] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b09036d-f422-41d0-af9e-74fbcbfb71a6: rpc.has_security_group_logging(os_id): False [ 657.061024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.061024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.061024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.061024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.063200] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.065043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.065043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.065043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.065043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.065043] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 is going to be created. [ 657.105911] env[66364]: INFO networking_nsxv3.common.synchronization [None req-97f4704e-aa1b-4d22-9ec0-c9c9dae7eb70 None None] Enqueued Resource ID: 9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e with Priority: HIGHEST for action port [ 657.106492] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e with Priority: HIGHEST for action port [ 657.107081] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.107199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.107255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.107505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.107638] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.129326] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.129497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.129570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.129776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.129957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.143789] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 in Status: IN_PROGRESS for 2s [ 657.364963] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.484140] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.485056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.485056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.485263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.485263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.486088] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.486088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.486088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.486088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.486088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.486088] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 already deleted. [ 657.486088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.566296] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 657.566503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.610398] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e [ 657.610839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.610839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.610839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.611359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.611359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.611359] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e already deleted. [ 657.611359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f164ecb-6e8b-4c1d-93cc-5f8e91b3909e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.753269] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.753472] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.753577] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.753855] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.754121] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.754365] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.754486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.754717] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.754853] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.755065] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.755171] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.755270] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.755368] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.755469] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.755607] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.755689] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.757775] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 657.758045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.758548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.758732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.758898] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.759081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.759140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.759291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.759372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.759465] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.775678] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 657.775894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.776444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.776675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.776763] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.780831] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.780986] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.781130] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.781291] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.781693] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.781866] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.781977] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.782305] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.782462] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c2aca4b-790b-4811-9ef9-6690e6b8cbc6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.868486] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.868669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.868715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.868957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.869086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.869186] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37506c58-083d-46d9-8010-be6545a2e954 is going to be created. [ 657.892946] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.893128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.893213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.893406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.893561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.904332] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: UNINITIALIZED for 2s [ 658.264109] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.264525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.264525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.264854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.264955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.265213] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.265325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.265388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.265581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.265701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.265832] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 658.278875] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.279021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.279096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.279321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.279523] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.279627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.279688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.279882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.280015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.280169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.280324] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.287333] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.287333] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.287333] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.287333] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.287333] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.287333] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 9c2aca4b-790b-4811-9ef9-6690e6b8cbc6 not found, creating... [ 658.287333] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.287333] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.287333] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.287742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.287742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.288777] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.288777] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.288777] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.289088] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.289088] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.289321] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 9c2aca4b-790b-4811-9ef9-6690e6b8cbc6 is going to be created. [ 658.320664] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.321208] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.321208] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.321351] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.321618] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.321874] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.323450] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.323584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.323629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.323829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.323972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.337082] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 658.786314] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.786314] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.786314] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.786314] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.786314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.787241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.787241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.787241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.787241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.787241] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.019127] env[66364]: INFO networking_nsxv3.common.synchronization [req-254fd78e-efa1-49cb-a350-d424ebf9a92b req-61303422-e69d-4826-a074-4a7eebeaa2cb service nova] Enqueued Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGHEST for action security_group_rules [ 659.019397] env[66364]: INFO networking_nsxv3.common.synchronization [req-254fd78e-efa1-49cb-a350-d424ebf9a92b req-61303422-e69d-4826-a074-4a7eebeaa2cb service nova] Enqueued Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGHEST for action security_group_members [ 659.019636] env[66364]: INFO networking_nsxv3.common.synchronization [req-254fd78e-efa1-49cb-a350-d424ebf9a92b req-61303422-e69d-4826-a074-4a7eebeaa2cb service nova] Enqueued Resource ID: 9c2aca4b-790b-4811-9ef9-6690e6b8cbc6 with Priority: HIGHEST for action port [ 659.020147] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGHEST for action security_group_rules [ 659.021849] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGHEST for action security_group_members [ 659.022016] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c2aca4b-790b-4811-9ef9-6690e6b8cbc6 with Priority: HIGHEST for action port [ 659.022349] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.022502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.022597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.022916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.023708] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19e02b7c-5738-40ef-bfaa-0d499061b1d5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.025302] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-19e02b7c-5738-40ef-bfaa-0d499061b1d5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.025460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.025542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.025799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.026043] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.026182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.026966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.027222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.027429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.027639] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19e02b7c-5738-40ef-bfaa-0d499061b1d5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.028913] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.029045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.029114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.029286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.029372] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c2aca4b-790b-4811-9ef9-6690e6b8cbc6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.160991] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 in Status: SUCCESS [ 659.161218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.289025] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5467face-590a-4281-b5c2-cf02d5a2e65f: rpc.has_security_group_logging(os_id): False [ 659.314725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.314880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.315030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.315859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.316068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.317691] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.317785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.317858] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.318067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.318154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.318461] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.318570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.318633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.318791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.318886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.319229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.319405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.319550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.319714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.319795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.319921] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be updated. [ 659.389114] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.389290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.389378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.389639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.389795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.396078] env[66364]: INFO networking_nsxv3.common.synchronization [req-9eb88325-26b5-4fa2-96e8-edb04b5e2a2f req-ff264386-c073-47c4-a254-0a9632a775e8 tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 659.396078] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 659.396347] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.396547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.396660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.397030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.397297] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.397509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.397573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.397825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.398082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.398082] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.406396] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 659.532354] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19e02b7c-5738-40ef-bfaa-0d499061b1d5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.532893] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-19e02b7c-5738-40ef-bfaa-0d499061b1d5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.533027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.533179] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c2aca4b-790b-4811-9ef9-6690e6b8cbc6 with status ACTIVE [ 659.533343] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.533490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.533561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.533717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.533805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.533987] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.534083] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.534145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.534303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.534374] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.534558] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.534649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.535730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.535730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.535730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.535730] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c2aca4b-790b-4811-9ef9-6690e6b8cbc6 is going to be updated. [ 659.565588] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.565818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.565893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.566081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.566290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.566462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c2aca4b-790b-4811-9ef9-6690e6b8cbc6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.904182] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.904336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.904401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.904618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.904710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.904890] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.905012] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.905070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.905212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.905317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.907390] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 already deleted. [ 659.907390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.915581] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: SUCCESS [ 659.915818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.915996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.916673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.916673] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.916673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.916673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.916968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.916968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.916968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.917129] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.920483] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.920742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.921062] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.921193] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.921370] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.922280] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.922280] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.922280] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.922280] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.922280] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.922576] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.922576] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.922576] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.922720] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.922848] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.922974] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.943296] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.943458] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.943583] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.943742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.944053] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.944223] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.944322] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.944737] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.944737] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.032095] env[66364]: INFO networking_nsxv3.common.synchronization [None req-bdfad044-af95-4481-8fb9-c469fef1acc7 tempest-ServersTestManualDisk-297421654 tempest-ServersTestManualDisk-297421654-project-member] Enqueued Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_rules [ 660.032436] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_rules [ 660.032841] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.032985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.033075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.033314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.033396] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.039491] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19e02b7c-5738-40ef-bfaa-0d499061b1d5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.349063] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 660.349063] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b deletion is rescheduled due to dependency. [ 660.349063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.349063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.349063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.349840] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.349840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.349840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.349840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.349840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.349840] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.425108] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.447758] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.447984] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.448121] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.448395] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.448540] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.448720] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 not found, creating... [ 660.448941] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.449109] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.449220] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.449491] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.449610] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.450101] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.450229] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.450393] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.450453] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.450584] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.450715] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 is going to be created. [ 660.485731] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.486622] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.486622] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.486622] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.487105] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.487356] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.541947] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.542157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.542266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.542433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.542522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.542700] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 is going to be created. [ 660.560576] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.560768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.560837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.561076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.561371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.561371] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d already deleted. [ 660.561599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.602732] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.602962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.602962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.603166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.603325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.643038] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 in Status: UNINITIALIZED for 2s [ 660.676507] env[66364]: INFO networking_nsxv3.common.synchronization [None req-96137da9-c3c1-4303-a507-672df2ffd6a8 None None] Enqueued Resource ID: 0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0 with Priority: HIGHEST for action port [ 660.677500] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0 with Priority: HIGHEST for action port [ 660.677994] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.678144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.678206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.678480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.678606] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.852100] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.852292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.852338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.852578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.852712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.852924] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.853039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.853103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.853271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.853348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.853433] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 660.917699] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.917887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.917932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.918442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.918593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.929766] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37506c58-083d-46d9-8010-be6545a2e954: rpc.has_security_group_logging(os_id): False [ 660.939411] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 660.970044] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.970276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.970372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.970630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.970765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.971117] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.971262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.971355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.971589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.971701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.971845] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37506c58-083d-46d9-8010-be6545a2e954 is going to be created. [ 661.061640] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.061793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.061864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.063747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.063996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.083723] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: IN_PROGRESS for 2s [ 661.183118] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0 [ 661.183118] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.183118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.183118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.183118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.183118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.183118] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0 already deleted. [ 661.183118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0033f8b0-52bb-49b6-8fd3-bbadfe83d9f0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.226401] env[66364]: INFO networking_nsxv3.common.synchronization [None req-6e5da556-ba32-4016-8a6a-d78a027730c8 tempest-ServersTestManualDisk-297421654 tempest-ServersTestManualDisk-297421654-project-member] Enqueued Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_rules [ 661.227131] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_rules [ 661.228970] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.228970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.228970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.228970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.228970] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.374051] env[66364]: INFO networking_nsxv3.common.synchronization [req-9eb88325-26b5-4fa2-96e8-edb04b5e2a2f req-e89d885a-0a44-466b-8f64-1473a1869b62 service nova] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 661.374051] env[66364]: INFO networking_nsxv3.common.synchronization [req-9eb88325-26b5-4fa2-96e8-edb04b5e2a2f req-e89d885a-0a44-466b-8f64-1473a1869b62 service nova] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 661.374051] env[66364]: INFO networking_nsxv3.common.synchronization [req-9eb88325-26b5-4fa2-96e8-edb04b5e2a2f req-e89d885a-0a44-466b-8f64-1473a1869b62 service nova] Enqueued Resource ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 with Priority: HIGHEST for action port [ 661.378627] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 661.378627] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 661.378627] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 with Priority: HIGHEST for action port [ 661.378627] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.378627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.378627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.378627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.378627] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.382142] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.383028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.383028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.383028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.383028] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.383265] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.383265] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.383339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.384226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.384226] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.384558] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.384669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.384669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.385742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.385742] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.422627] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 661.426023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.749927] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.751031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.751031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.751031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.751239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.751239] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d already deleted. [ 661.751239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.988922] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.988922] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.988922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.988922] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 with status ACTIVE [ 661.988922] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.988922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.988922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.988922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.988922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.988922] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.988922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.988922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.988922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.988922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.996695] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.996695] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 is going to be updated. [ 661.996695] env[66364]: INFO networking_nsxv3.common.synchronization [req-74d715d8-1d0b-48fc-be75-4d9bc2b165bb req-e162700a-a718-4c4f-b7f6-fd103f0cadd2 tempest-DeleteServersAdminTestJSON-506624089 tempest-DeleteServersAdminTestJSON-506624089-project-member] Enqueued Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 661.996695] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 661.996695] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.996695] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.996695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.996695] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.008246] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.008246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.008246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.008246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.008246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.008246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.396410] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.430019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.430019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.430019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.430019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.430019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.430019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.430019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.430019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.430019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.430019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.430019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a is going to be updated. [ 662.443194] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.443194] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.443194] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.443194] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.443194] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.443630] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.443833] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.444124] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.444301] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.444667] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.444667] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.444826] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.444887] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.444989] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.445117] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.445296] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.458112] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.458405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.458405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.458620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.458762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.465301] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.465757] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.465757] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.465930] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.466361] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-ab084be6-d266-4875-ad1d-08455418b4ea taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.466583] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-ab084be6-d266-4875-ad1d-08455418b4ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.466771] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-ab084be6-d266-4875-ad1d-08455418b4ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.467276] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-ab084be6-d266-4875-ad1d-08455418b4ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.467495] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab084be6-d266-4875-ad1d-08455418b4ea',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.469762] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: IN_PROGRESS for 2s [ 662.653643] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 in Status: SUCCESS [ 662.653959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.654340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.654587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.654820] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.655055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.655195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.655543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.655625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.655761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.655840] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19e02b7c-5738-40ef-bfaa-0d499061b1d5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.899783] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.902318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.902318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.902318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.902318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.902318] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 is going to be created. [ 662.929806] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.930042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.930042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.930267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.930370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.941379] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: UNINITIALIZED for 2s [ 662.958623] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 662.958735] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b deletion is rescheduled due to dependency. [ 662.958798] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.974032] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.974032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.974032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.974032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.974032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.974032] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port ab084be6-d266-4875-ad1d-08455418b4ea not found, creating... [ 662.974032] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.974032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.974032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.974032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.974032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.974637] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.974637] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.974637] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.974764] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.974798] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.975020] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: ab084be6-d266-4875-ad1d-08455418b4ea is going to be created. [ 663.002790] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.003118] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.003300] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.003681] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.004883] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.004883] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-ab084be6-d266-4875-ad1d-08455418b4ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.057474] env[66364]: INFO networking_nsxv3.common.synchronization [None req-712a8b7f-4415-427f-94fd-0f645a0b838f None None] Enqueued Resource ID: 243bcd53-b82f-4c56-b873-06bc67a2cfc8 with Priority: HIGHEST for action port [ 663.058133] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 243bcd53-b82f-4c56-b873-06bc67a2cfc8 with Priority: HIGHEST for action port [ 663.058463] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-243bcd53-b82f-4c56-b873-06bc67a2cfc8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.058679] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-243bcd53-b82f-4c56-b873-06bc67a2cfc8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.058679] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-243bcd53-b82f-4c56-b873-06bc67a2cfc8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.058954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-243bcd53-b82f-4c56-b873-06bc67a2cfc8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.059065] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('243bcd53-b82f-4c56-b873-06bc67a2cfc8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.104812] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: SUCCESS [ 663.105177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.158634] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-19e02b7c-5738-40ef-bfaa-0d499061b1d5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.158947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.158947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.159262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.159388] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.159630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.159764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.159954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.160063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.160224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.160529] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-19e02b7c-5738-40ef-bfaa-0d499061b1d5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.160743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.160825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.161046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.161277] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.161508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.161576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.161881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.161965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.162268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.162414] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19e02b7c-5738-40ef-bfaa-0d499061b1d5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.561022] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 243bcd53-b82f-4c56-b873-06bc67a2cfc8 [ 663.561343] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.563669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.563669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.563669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.563669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.563669] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:243bcd53-b82f-4c56-b873-06bc67a2cfc8 already deleted. [ 663.563669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-243bcd53-b82f-4c56-b873-06bc67a2cfc8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.667021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19e02b7c-5738-40ef-bfaa-0d499061b1d5: rpc.has_security_group_logging(os_id): False [ 663.687797] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.688822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.689098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.689159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.689305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.689667] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.689812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.689871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.690971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.690971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.690971] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.690971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.690971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.690971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.690971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.690971] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.691406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.691698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.691892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.691994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.692115] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 is going to be created. [ 663.756529] env[66364]: INFO networking_nsxv3.common.synchronization [req-74d715d8-1d0b-48fc-be75-4d9bc2b165bb req-83ae5185-63a4-4183-9c2a-ad182a4374f1 service nova] Enqueued Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_rules [ 663.758228] env[66364]: INFO networking_nsxv3.common.synchronization [req-74d715d8-1d0b-48fc-be75-4d9bc2b165bb req-83ae5185-63a4-4183-9c2a-ad182a4374f1 service nova] Enqueued Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 663.758228] env[66364]: INFO networking_nsxv3.common.synchronization [req-74d715d8-1d0b-48fc-be75-4d9bc2b165bb req-83ae5185-63a4-4183-9c2a-ad182a4374f1 service nova] Enqueued Resource ID: ab084be6-d266-4875-ad1d-08455418b4ea with Priority: HIGHEST for action port [ 663.758228] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_rules [ 663.758228] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 663.758228] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab084be6-d266-4875-ad1d-08455418b4ea with Priority: HIGHEST for action port [ 663.758228] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.758228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.760688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.760688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.760824] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.762911] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.767148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.767148] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab084be6-d266-4875-ad1d-08455418b4ea taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.767148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab084be6-d266-4875-ad1d-08455418b4ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.767148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab084be6-d266-4875-ad1d-08455418b4ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.767148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab084be6-d266-4875-ad1d-08455418b4ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.767148] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab084be6-d266-4875-ad1d-08455418b4ea',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.772288] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.772471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.772471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.772697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.772871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.789585] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 in Status: IN_PROGRESS for 2s [ 664.268745] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.268959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.275448] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab084be6-d266-4875-ad1d-08455418b4ea with status ACTIVE [ 664.275721] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.276135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.276226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.276485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.276602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.278470] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.278682] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.278844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.279111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.279292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.279751] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.279926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.279999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.280222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.280314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.280389] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab084be6-d266-4875-ad1d-08455418b4ea is going to be updated. [ 664.312951] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.313311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.313311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.313453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.313803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.313803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab084be6-d266-4875-ad1d-08455418b4ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.483754] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: SUCCESS [ 664.483910] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a deletion is rescheduled due to dependency. [ 664.484040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.484229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.484569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.484723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.484825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.484825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.484947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.485863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.485863] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.955021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: SUCCESS [ 664.955021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.955021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.955021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.955021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.955021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.955021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.955021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.955021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.955021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.955021] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.987231] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.458120] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.489058] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.804809] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 in Status: SUCCESS [ 665.805070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.962774] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce5e068-6071-492c-83e7-d1b6b7551653: rpc.has_security_group_logging(os_id): False [ 665.983581] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.983791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.983868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.984883] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.984883] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.984883] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.987090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.987090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.988189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.988189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.988189] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 is going to be created. [ 665.991695] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.991695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.991935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.992334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.994561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.994561] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a is going to be updated. [ 666.032053] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.032053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.032053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.032053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.032053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.044107] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: IN_PROGRESS for 2s [ 666.076537] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.076728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.076728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.076951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.077155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.090642] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: IN_PROGRESS for 2s [ 667.799866] env[66364]: INFO networking_nsxv3.common.synchronization [None req-bba87bc5-0b06-42c7-b61e-225f4d7a0286 None None] Enqueued Resource ID: 32f7764e-ea04-493d-a37c-6b37c019cab0 with Priority: HIGHEST for action port [ 667.800917] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f7764e-ea04-493d-a37c-6b37c019cab0 with Priority: HIGHEST for action port [ 667.800917] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-32f7764e-ea04-493d-a37c-6b37c019cab0 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.800917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32f7764e-ea04-493d-a37c-6b37c019cab0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.801086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32f7764e-ea04-493d-a37c-6b37c019cab0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.803673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32f7764e-ea04-493d-a37c-6b37c019cab0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.803752] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32f7764e-ea04-493d-a37c-6b37c019cab0',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.068430] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: SUCCESS [ 668.068731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.068979] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.069295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.069591] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.069923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.069923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.071086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.071290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.071748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.071748] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.110021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: SUCCESS [ 668.110338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.306458] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32f7764e-ea04-493d-a37c-6b37c019cab0 [ 668.306729] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.306899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.306970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.307240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.307345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.307461] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32f7764e-ea04-493d-a37c-6b37c019cab0 already deleted. [ 668.307552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32f7764e-ea04-493d-a37c-6b37c019cab0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.577723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.577723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.577723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.577723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.577723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.578515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.578515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.578515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.578515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.578515] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.081869] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b57d473-6bcb-4eff-94aa-74472df3d57a: rpc.has_security_group_logging(os_id): False [ 669.106237] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.107741] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.107741] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.108520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.108520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.108520] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.108520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.108520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.108520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.108520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.108520] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a is going to be updated. [ 669.176136] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.176136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.176136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.176136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.176136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.191082] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: IN_PROGRESS for 2s [ 669.520224] env[66364]: INFO networking_nsxv3.common.synchronization [req-33ffdb64-6f8d-4841-ba0e-c960773514be req-81e82284-02c9-4c31-aaf4-9b3d9994b881 tempest-ListServerFiltersTestJSON-936474167 tempest-ListServerFiltersTestJSON-936474167-project-member] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 669.520224] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 669.520326] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.521263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.521263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.521263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.521263] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.521263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.521263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.521755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.521755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.521755] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.025873] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.025873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.025873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.025873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.025873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.025873] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.025873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.025873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.025873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.025873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.025873] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 already deleted. [ 670.025873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.054576] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.054762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.054815] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.055206] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.055385] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.055560] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.055667] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.055905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.056265] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.056518] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.056631] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.056735] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.056835] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.056936] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.057789] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.057789] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.081389] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.081741] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.081741] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.081934] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.082330] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.083359] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.083359] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.083694] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.083847] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1989ae61-31fb-4aaf-b0c2-b988ab63cadf',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.586187] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.586490] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.586569] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.586800] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.587011] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.587112] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 1989ae61-31fb-4aaf-b0c2-b988ab63cadf not found, creating... [ 670.587368] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.587515] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.587619] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.587831] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.587968] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.588420] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.588599] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.588779] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.588989] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.589133] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.589263] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 1989ae61-31fb-4aaf-b0c2-b988ab63cadf is going to be created. [ 670.615846] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.616315] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.616751] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.617324] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.617677] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.618763] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.209805] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: SUCCESS [ 671.209805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.397293] env[66364]: INFO networking_nsxv3.common.synchronization [req-33ffdb64-6f8d-4841-ba0e-c960773514be req-292e006a-3f65-4a54-b745-2f033ad368d2 service nova] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_rules [ 671.397293] env[66364]: INFO networking_nsxv3.common.synchronization [req-33ffdb64-6f8d-4841-ba0e-c960773514be req-292e006a-3f65-4a54-b745-2f033ad368d2 service nova] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 671.397293] env[66364]: INFO networking_nsxv3.common.synchronization [req-33ffdb64-6f8d-4841-ba0e-c960773514be req-292e006a-3f65-4a54-b745-2f033ad368d2 service nova] Enqueued Resource ID: 1989ae61-31fb-4aaf-b0c2-b988ab63cadf with Priority: HIGHEST for action port [ 671.397979] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_rules [ 671.398228] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 671.398412] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1989ae61-31fb-4aaf-b0c2-b988ab63cadf with Priority: HIGHEST for action port [ 671.398953] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.399102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.399171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.399535] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.399628] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.400948] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.401081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.401164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.401355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.401546] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.401691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.401771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.401948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.402154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.402343] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.403532] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.403659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.403729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.403889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.403996] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1989ae61-31fb-4aaf-b0c2-b988ab63cadf',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.622037] env[66364]: INFO networking_nsxv3.common.synchronization [req-ef82475a-ef16-4465-a1c4-cef5bf4e5ae3 req-b201ab63-ad91-4c36-9d5a-f5162c916ae8 tempest-ListServersNegativeTestJSON-713481304 tempest-ListServersNegativeTestJSON-713481304-project-member] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 671.622710] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 671.623389] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.623519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.624166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.624166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.624166] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.624166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.624408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.624408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.624496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.624533] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.906895] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.907641] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.908451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.908451] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1989ae61-31fb-4aaf-b0c2-b988ab63cadf with status ACTIVE [ 671.908451] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.908451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.908451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.908697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.908697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.908856] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.909778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.909778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.909992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.910229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.910477] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.910605] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.910674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.911526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.911526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.911526] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1989ae61-31fb-4aaf-b0c2-b988ab63cadf is going to be updated. [ 671.934845] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.935064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.935064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.936391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.936391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.936391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1989ae61-31fb-4aaf-b0c2-b988ab63cadf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.127051] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.413675] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.630038] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.917554] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.917794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.917794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.918096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.918096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.918286] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be created. [ 672.950938] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.950938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.950938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.951331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.951331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.964286] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: UNINITIALIZED for 2s [ 673.134068] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.134068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.134068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.134068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.134068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.134068] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be updated. [ 673.169747] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.169952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.169952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.170186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.170331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.183087] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 674.605839] env[66364]: INFO networking_nsxv3.common.synchronization [req-c2835109-b3d8-40ab-9c90-c7df0ed6f7e1 req-f6d28146-9956-4dab-85f4-78016d66f0df tempest-ServersAdminTestJSON-1239172367 tempest-ServersAdminTestJSON-1239172367-project-member] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 674.608285] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 674.608285] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.608804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.608804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.608928] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.609744] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.609744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.609744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.609744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.609744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.609744] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.972707] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 674.972915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.973080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.973286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.973463] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.973570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.973630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.973775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.973850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.973926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.974026] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.039180] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-585 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.039363] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.039482] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.039849] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.040136] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.040295] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.040646] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.040646] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.040782] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.040951] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.041076] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.041180] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.041315] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.041380] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.041476] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.041613] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.062627] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.062811] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.062937] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.063136] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.063540] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-4012174b-d025-4510-8219-538366316153 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.063729] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-4012174b-d025-4510-8219-538366316153" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.063845] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-4012174b-d025-4510-8219-538366316153" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.064214] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-4012174b-d025-4510-8219-538366316153" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.064347] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4012174b-d025-4510-8219-538366316153',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.112063] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.194329] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 675.194726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.476196] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.476368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.476444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.476667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.477124] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.477244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.477309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.477474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.477562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.477649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.477796] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.477955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.477955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.478118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.478239] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.478329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.478386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.478519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.478654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.478763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.478856] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.567764] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.568028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.568164] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.568475] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.568626] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.568835] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 4012174b-d025-4510-8219-538366316153 not found, creating... [ 675.569134] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.569307] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.569444] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.569781] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.570063] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.570495] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.570658] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.570772] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.571022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.571182] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.571293] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 4012174b-d025-4510-8219-538366316153 is going to be created. [ 675.594637] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.594850] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.594969] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.595263] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.595506] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.595719] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-4012174b-d025-4510-8219-538366316153" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.615401] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.981295] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b563fa6-e694-4628-a9da-1beb0ee48864: rpc.has_security_group_logging(os_id): False [ 676.007084] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.007084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.007084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.007084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.007084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.007084] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.007084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.007084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.009061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.009223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.009495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.009714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.009823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.010649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.010649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.010649] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.010649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.010932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.011825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.013093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.013093] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be created. [ 676.085165] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.085361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.085439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.085686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.085890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.101996] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 676.117792] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.117964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.118098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.118459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.118557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.118667] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 676.160564] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.160752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.160833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.162036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.162036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.178480] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 676.447422] env[66364]: INFO networking_nsxv3.common.synchronization [req-c2835109-b3d8-40ab-9c90-c7df0ed6f7e1 req-bcddc12b-ee87-4e9f-91fd-f2b875cb1d45 service nova] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_rules [ 676.447542] env[66364]: INFO networking_nsxv3.common.synchronization [req-c2835109-b3d8-40ab-9c90-c7df0ed6f7e1 req-bcddc12b-ee87-4e9f-91fd-f2b875cb1d45 service nova] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 676.447676] env[66364]: INFO networking_nsxv3.common.synchronization [req-c2835109-b3d8-40ab-9c90-c7df0ed6f7e1 req-bcddc12b-ee87-4e9f-91fd-f2b875cb1d45 service nova] Enqueued Resource ID: 4012174b-d025-4510-8219-538366316153 with Priority: HIGHEST for action port [ 676.447966] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_rules [ 676.452113] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 676.452113] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4012174b-d025-4510-8219-538366316153 with Priority: HIGHEST for action port [ 676.452938] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.452938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.452938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.453229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.453229] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.454130] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.454221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.454422] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-4012174b-d025-4510-8219-538366316153 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.454558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4012174b-d025-4510-8219-538366316153" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.454558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4012174b-d025-4510-8219-538366316153" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.454732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4012174b-d025-4510-8219-538366316153" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.454801] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4012174b-d025-4510-8219-538366316153',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.798799] env[66364]: INFO networking_nsxv3.common.synchronization [req-4288a51e-ff37-4a0f-a8ad-1e21bb5d8f4c req-8fb31ace-2adc-4e45-ab73-a6f5850356c1 tempest-FloatingIPsAssociationTestJSON-640590749 tempest-FloatingIPsAssociationTestJSON-640590749-project-member] Enqueued Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 676.799359] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 676.799688] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.799806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.799871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.800205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.800266] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.800331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.800383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.800523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.800606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.800698] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.956818] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.957016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.957673] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4012174b-d025-4510-8219-538366316153 with status ACTIVE [ 676.958246] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.958246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.958246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.958246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.958484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.958560] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.958648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.959231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.959418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.959505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.959689] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.959857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.959857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.960025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.960067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.960137] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4012174b-d025-4510-8219-538366316153 is going to be updated. [ 676.987312] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.987495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.987495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.987651] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.987892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.987892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4012174b-d025-4510-8219-538366316153" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.304967] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.328086] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-86 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.328086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.328086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.328086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.328086] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.328086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.328086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.329425] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.329690] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.330516] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.330516] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 677.330516] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 677.330712] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 677.330930] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 677.331456] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 677.331456] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 677.353113] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 677.354388] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 677.354586] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 677.354731] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.355060] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-296c9f45-44a0-402b-a223-aa435c991897 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.355239] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-296c9f45-44a0-402b-a223-aa435c991897" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.355373] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-296c9f45-44a0-402b-a223-aa435c991897" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.355669] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-296c9f45-44a0-402b-a223-aa435c991897" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.355831] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('296c9f45-44a0-402b-a223-aa435c991897',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.807887] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.858896] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.859177] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.859289] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.859616] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.859740] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.859872] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 296c9f45-44a0-402b-a223-aa435c991897 not found, creating... [ 677.860121] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.860335] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.860518] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.860820] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.860929] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.861226] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.861375] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.861481] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.861713] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.861856] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.861971] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 296c9f45-44a0-402b-a223-aa435c991897 is going to be created. [ 677.893781] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.894107] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.894272] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.894617] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.894877] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.895151] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-296c9f45-44a0-402b-a223-aa435c991897" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.125400] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 678.126617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.188667] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 678.188894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.189078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.189308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.189496] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.189649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.189742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.189943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.190371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.190371] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.310087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.310302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.310302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.310524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.311435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.311435] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 is going to be updated. [ 678.347954] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.348326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.348326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.348426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.348496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.359733] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: IN_PROGRESS for 2s [ 678.610194] env[66364]: INFO networking_nsxv3.common.synchronization [req-4288a51e-ff37-4a0f-a8ad-1e21bb5d8f4c req-53bf909b-4d9b-42ef-9559-d1e1e0b0596d service nova] Enqueued Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_rules [ 678.610351] env[66364]: INFO networking_nsxv3.common.synchronization [req-4288a51e-ff37-4a0f-a8ad-1e21bb5d8f4c req-53bf909b-4d9b-42ef-9559-d1e1e0b0596d service nova] Enqueued Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 678.610476] env[66364]: INFO networking_nsxv3.common.synchronization [req-4288a51e-ff37-4a0f-a8ad-1e21bb5d8f4c req-53bf909b-4d9b-42ef-9559-d1e1e0b0596d service nova] Enqueued Resource ID: 296c9f45-44a0-402b-a223-aa435c991897 with Priority: HIGHEST for action port [ 678.611012] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_rules [ 678.611154] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 678.611248] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296c9f45-44a0-402b-a223-aa435c991897 with Priority: HIGHEST for action port [ 678.611510] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.611631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.611764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.611945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.612097] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.613068] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.613174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.613370] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-296c9f45-44a0-402b-a223-aa435c991897 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.613468] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-296c9f45-44a0-402b-a223-aa435c991897" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.613532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-296c9f45-44a0-402b-a223-aa435c991897" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.613725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-296c9f45-44a0-402b-a223-aa435c991897" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.613925] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('296c9f45-44a0-402b-a223-aa435c991897',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.695160] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.115680] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.116025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.116025] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 296c9f45-44a0-402b-a223-aa435c991897 with status ACTIVE [ 679.116397] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.116397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.116397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.116561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.116597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.116768] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.116860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.116918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.117554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.117554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.117554] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.117554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.117554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.117802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.117802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.117802] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 296c9f45-44a0-402b-a223-aa435c991897 is going to be updated. [ 679.141295] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.141433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.141433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.142299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.142299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.142299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-296c9f45-44a0-402b-a223-aa435c991897" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.197956] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.671259] env[66364]: INFO networking_nsxv3.common.synchronization [req-49f65f68-59e7-488d-b5d2-53e7d67231ad req-f050c6cb-a92c-4908-be9c-45f9d2704712 tempest-ListServerFiltersTestJSON-936474167 tempest-ListServerFiltersTestJSON-936474167-project-member] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 679.671259] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 679.671259] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.671259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.671259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.671259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.673235] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.673932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.673932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.673932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.674158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.674254] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.701214] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.701214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.701214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.701214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.701214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.701525] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 679.733768] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.733915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.733976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.734200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.734357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.743606] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 680.104106] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.104920] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.105174] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.106720] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.107000] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.108533] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.108533] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.109522] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.109734] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.110448] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.110597] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.110679] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.110781] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.111264] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.111722] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.112702] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.133166] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.133503] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.133503] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.133620] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.133931] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-50903642-b6cc-4066-88e8-4d13e51683a1 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.134218] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-50903642-b6cc-4066-88e8-4d13e51683a1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.134373] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-50903642-b6cc-4066-88e8-4d13e51683a1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.134782] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-50903642-b6cc-4066-88e8-4d13e51683a1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.134782] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50903642-b6cc-4066-88e8-4d13e51683a1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.177841] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.371691] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: SUCCESS [ 680.371836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.372303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.372303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.372469] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.372642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.372730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.373208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.373208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.373208] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.640546] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.640786] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.640868] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.641267] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.641431] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.641584] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 50903642-b6cc-4066-88e8-4d13e51683a1 not found, creating... [ 680.641900] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.642146] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.642265] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.642487] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.642611] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.642882] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.643037] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.643148] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.643352] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.643472] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.643599] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 50903642-b6cc-4066-88e8-4d13e51683a1 is going to be created. [ 680.666578] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.666798] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.666887] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.667202] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.667425] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.667637] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-50903642-b6cc-4066-88e8-4d13e51683a1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.680512] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.875304] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.182938] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.184577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.184664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.184887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.184985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.185104] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be updated. [ 681.215810] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.215993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.216072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.216291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.216436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.227322] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 681.379394] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.419073] env[66364]: INFO networking_nsxv3.common.synchronization [req-49f65f68-59e7-488d-b5d2-53e7d67231ad req-63438c02-2426-4b01-8946-3191230c3f89 service nova] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_rules [ 681.419256] env[66364]: INFO networking_nsxv3.common.synchronization [req-49f65f68-59e7-488d-b5d2-53e7d67231ad req-63438c02-2426-4b01-8946-3191230c3f89 service nova] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 681.419390] env[66364]: INFO networking_nsxv3.common.synchronization [req-49f65f68-59e7-488d-b5d2-53e7d67231ad req-63438c02-2426-4b01-8946-3191230c3f89 service nova] Enqueued Resource ID: 50903642-b6cc-4066-88e8-4d13e51683a1 with Priority: HIGHEST for action port [ 681.420263] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_rules [ 681.420497] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 681.420628] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50903642-b6cc-4066-88e8-4d13e51683a1 with Priority: HIGHEST for action port [ 681.420932] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.421026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.421106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.421304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.421382] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.422667] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.422813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.423238] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-50903642-b6cc-4066-88e8-4d13e51683a1 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.423238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50903642-b6cc-4066-88e8-4d13e51683a1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.423238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50903642-b6cc-4066-88e8-4d13e51683a1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.423419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50903642-b6cc-4066-88e8-4d13e51683a1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.425810] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50903642-b6cc-4066-88e8-4d13e51683a1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.756074] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 681.756770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.756976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.757243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.757443] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.757561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.757624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.757779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.757861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.757945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.758046] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.882621] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.887080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.887080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.887080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.887080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.887080] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 is going to be updated. [ 681.925342] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.925490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.925578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.925813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.925994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.928557] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.928557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.928557] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50903642-b6cc-4066-88e8-4d13e51683a1 with status ACTIVE [ 681.928557] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.928557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.928557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.928557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.928557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.928557] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.928557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.928557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.929041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.929041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.929041] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.929170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.929170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.929673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.929802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.929896] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50903642-b6cc-4066-88e8-4d13e51683a1 is going to be updated. [ 681.940425] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: IN_PROGRESS for 2s [ 681.952043] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.952043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.952043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.952043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.952043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.952043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50903642-b6cc-4066-88e8-4d13e51683a1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.266342] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.266342] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.266342] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.266342] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.266342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.268606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.268606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.268606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.268606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.268606] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.770942] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebb41e34-3a6d-4c7e-a19c-48afdcc86d62: rpc.has_security_group_logging(os_id): False [ 682.795194] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.795194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.795340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.795481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.795580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.795773] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.796373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.796373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.796373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.796373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.796373] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.796585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.796585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.796650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.796684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.796919] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.797024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.797124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.797224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.797298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.797378] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 682.889209] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.889440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.889566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.889895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.890171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.906481] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 683.243305] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 683.243613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.243832] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.244085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.244895] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.244895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.244895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.244895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.245791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.245791] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.755083] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.952273] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: SUCCESS [ 683.952560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.952822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.953090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.953319] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.953499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.953606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.954859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.954859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.954859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.954859] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.258034] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.458609] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.458841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.458949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.459259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.459468] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.459658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.459780] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.459993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.460190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.460255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.460505] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.460612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.460673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.460829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.460972] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.461083] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.461143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.461351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.461437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.461519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.461610] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.760975] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.760975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.760975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.760975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.761629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.761629] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be updated. [ 684.797228] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.797441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.797508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.797716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.797953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.812025] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 684.923590] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 684.923815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.963866] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1861e5fb-2be6-4354-a9e1-67fd55022b22: rpc.has_security_group_logging(os_id): False [ 684.982040] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.982339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.982339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.982508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.982624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.982962] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.983112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.983225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.983514] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.983673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.983927] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.984098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.984206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.984413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.984562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.984823] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.984948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.985060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.985215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.985295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.985378] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 is going to be updated. [ 685.058272] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.058435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.058527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.058753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.058953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.076580] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: IN_PROGRESS for 2s [ 685.802367] env[66364]: INFO networking_nsxv3.common.synchronization [req-d59156b9-384a-4960-b75a-ab7e5d04e231 req-06586b2e-6dbd-46f1-879e-8aa8be3afce0 tempest-ImagesOneServerNegativeTestJSON-519635427 tempest-ImagesOneServerNegativeTestJSON-519635427-project-member] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 685.803027] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 685.803415] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.803594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.803681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.803941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.804173] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.804271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.804335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.807531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.807531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.807531] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.892961] env[66364]: INFO networking_nsxv3.common.synchronization [None req-e4c5e6a8-dcd7-4f58-912d-9413884fb6e6 None None] Enqueued Resource ID: 406a6720-545e-4510-b72e-aa99e0d62fd7 with Priority: HIGHEST for action port [ 685.894098] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406a6720-545e-4510-b72e-aa99e0d62fd7 with Priority: HIGHEST for action port [ 685.894754] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-406a6720-545e-4510-b72e-aa99e0d62fd7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.894968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-406a6720-545e-4510-b72e-aa99e0d62fd7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.895078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-406a6720-545e-4510-b72e-aa99e0d62fd7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.895449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-406a6720-545e-4510-b72e-aa99e0d62fd7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.895623] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('406a6720-545e-4510-b72e-aa99e0d62fd7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.307091] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.307880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.308046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.310186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.310186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.310186] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.310186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.310186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.310186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.310186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.310186] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be updated. [ 686.346583] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.346687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.346731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.346927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.347087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.361267] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 686.397970] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 406a6720-545e-4510-b72e-aa99e0d62fd7 [ 686.398248] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.398383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.398455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.402210] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.402376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.403736] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:406a6720-545e-4510-b72e-aa99e0d62fd7 already deleted. [ 686.403736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-406a6720-545e-4510-b72e-aa99e0d62fd7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.552016] env[66364]: INFO networking_nsxv3.common.synchronization [req-d8393491-04a8-4c49-bb55-5eaf325221ee req-22dfbf64-db3a-41aa-b7a4-df25592d9b11 tempest-DeleteServersAdminTestJSON-506624089 tempest-DeleteServersAdminTestJSON-506624089-project-member] Enqueued Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 686.553723] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGHEST for action security_group_members [ 686.554089] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.554199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.554257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.554456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.554604] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.554694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.554795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.554903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.554995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.555102] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.670772] env[66364]: INFO networking_nsxv3.common.synchronization [req-4aaec7a1-fca2-4205-8f42-a5c97f2c8f03 req-96a586cf-2d24-4de2-beca-c2b47df4a443 tempest-TenantUsagesTestJSON-1756635530 tempest-TenantUsagesTestJSON-1756635530-project-member] Enqueued Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGHEST for action security_group_members [ 686.671317] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGHEST for action security_group_members [ 686.671616] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-19e02b7c-5738-40ef-bfaa-0d499061b1d5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.671789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.671872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.673299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.673534] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.673607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.673661] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.673804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.673890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.673974] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19e02b7c-5738-40ef-bfaa-0d499061b1d5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.822402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 686.822694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.823203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.823419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.824533] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.824533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.824533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.824533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.824533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.824533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.824533] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.057211] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.057437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.057541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.057864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.057999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.058289] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.058438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.058533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.058760] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.058889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.060212] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a is going to be updated. [ 687.098410] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: SUCCESS [ 687.098658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.102071] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.102071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.102071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.102071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.102071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.113525] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: IN_PROGRESS for 2s [ 687.119976] env[66364]: INFO networking_nsxv3.common.synchronization [req-7161330f-dc3f-4886-b89e-b6f2323b2b37 req-bcc8b0de-dff8-4195-8ca8-51f2e6f2353d tempest-ListServerFiltersTestJSON-936474167 tempest-ListServerFiltersTestJSON-936474167-project-member] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 687.120543] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 687.120909] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.121045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.121108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.121305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.121456] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.121600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.121600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.121769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.121844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.121935] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.175993] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.176172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.176172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.176366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.176572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.176668] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.176737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.176811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.176944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.177033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.177112] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 is going to be updated. [ 687.211301] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.211807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.211807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.211949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.212022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.227325] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 in Status: IN_PROGRESS for 2s [ 687.327449] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.327449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.626912] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.640514] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.640514] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.640514] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.640514] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.640514] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.640514] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.640514] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.640838] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.641193] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.641193] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.641313] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.641378] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.641449] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.641550] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.641647] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.642307] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.665408] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.665560] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.665715] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.665894] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-444" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.666282] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-0e35f278-c925-4129-b19c-3223a8759009 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.666471] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-0e35f278-c925-4129-b19c-3223a8759009" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.667043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-0e35f278-c925-4129-b19c-3223a8759009" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.667043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-0e35f278-c925-4129-b19c-3223a8759009" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.667043] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e35f278-c925-4129-b19c-3223a8759009',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.105445] env[66364]: INFO networking_nsxv3.common.synchronization [None req-d7dc0ad5-0860-4252-b7b0-12b229612d84 None None] Enqueued Resource ID: 0d40e4d9-b7c4-4329-83c5-73144d50d54a with Priority: HIGHEST for action port [ 688.106587] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d40e4d9-b7c4-4329-83c5-73144d50d54a with Priority: HIGHEST for action port [ 688.106904] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d40e4d9-b7c4-4329-83c5-73144d50d54a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.107120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d40e4d9-b7c4-4329-83c5-73144d50d54a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.107120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d40e4d9-b7c4-4329-83c5-73144d50d54a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.107367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d40e4d9-b7c4-4329-83c5-73144d50d54a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.107483] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d40e4d9-b7c4-4329-83c5-73144d50d54a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.134331] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.169688] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.169688] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.169688] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.170225] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.170225] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.170349] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 0e35f278-c925-4129-b19c-3223a8759009 not found, creating... [ 688.172028] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.172028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.172028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.172028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.172028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.172028] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.172028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.172028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.172028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.173041] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.173307] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 0e35f278-c925-4129-b19c-3223a8759009 is going to be created. [ 688.198212] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.200737] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.200737] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.200737] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.200737] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.200737] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-0e35f278-c925-4129-b19c-3223a8759009" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.372473] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 688.372657] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f deletion is rescheduled due to dependency. [ 688.372806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.610214] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d40e4d9-b7c4-4329-83c5-73144d50d54a [ 688.611090] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.611090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.611090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.611090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.611090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.611090] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d40e4d9-b7c4-4329-83c5-73144d50d54a already deleted. [ 688.611393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d40e4d9-b7c4-4329-83c5-73144d50d54a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.638760] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.638760] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.638880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.639110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.639148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.639416] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be updated. [ 688.668664] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.668863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.668915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.669205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.669375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.679361] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 688.917808] env[66364]: INFO networking_nsxv3.common.synchronization [req-7161330f-dc3f-4886-b89e-b6f2323b2b37 req-8debd151-a7a4-497d-80a7-2fcf224b6777 service nova] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_rules [ 688.917970] env[66364]: INFO networking_nsxv3.common.synchronization [req-7161330f-dc3f-4886-b89e-b6f2323b2b37 req-8debd151-a7a4-497d-80a7-2fcf224b6777 service nova] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 688.918205] env[66364]: INFO networking_nsxv3.common.synchronization [req-7161330f-dc3f-4886-b89e-b6f2323b2b37 req-8debd151-a7a4-497d-80a7-2fcf224b6777 service nova] Enqueued Resource ID: 0e35f278-c925-4129-b19c-3223a8759009 with Priority: HIGHEST for action port [ 688.918340] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_rules [ 688.918468] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 688.918563] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e35f278-c925-4129-b19c-3223a8759009 with Priority: HIGHEST for action port [ 688.919839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.919839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.919839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.919839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.919839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e35f278-c925-4129-b19c-3223a8759009 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.920314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e35f278-c925-4129-b19c-3223a8759009" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.920314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e35f278-c925-4129-b19c-3223a8759009" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.920314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e35f278-c925-4129-b19c-3223a8759009" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.920314] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e35f278-c925-4129-b19c-3223a8759009',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.123356] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a in Status: SUCCESS [ 689.123658] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a deletion is rescheduled due to dependency. [ 689.123658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.233864] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 in Status: IN_PROGRESS for 4s [ 689.424619] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e35f278-c925-4129-b19c-3223a8759009 with status ACTIVE [ 689.424619] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.424619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.424619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.424859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.425298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.425298] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.425298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.425298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.425520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.425520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.425650] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.425738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.425810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.426164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.426164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.426164] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e35f278-c925-4129-b19c-3223a8759009 is going to be updated. [ 689.455733] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.455908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.455958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.456196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.456376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.456497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e35f278-c925-4129-b19c-3223a8759009" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.515077] env[66364]: INFO networking_nsxv3.common.synchronization [req-ca1e9389-069e-44d5-b54d-2673179a6e0e req-115068ad-a65a-4511-b9e7-bb508cc64b38 tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 689.516344] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 689.516344] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.516344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.516344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.516720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.517030] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.517206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.517283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.517381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.517634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.517634] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.949563] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-501 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.949779] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.949920] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.950211] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.950480] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.950631] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.950742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.950962] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.951642] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.951642] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.951642] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.951642] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.951642] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.952075] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.952075] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.952075] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.973859] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.974009] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 689.974266] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.974366] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.974739] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-99eff37c-0811-4e54-bcd4-f408ef5c81cc taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.975382] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-99eff37c-0811-4e54-bcd4-f408ef5c81cc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.975382] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-99eff37c-0811-4e54-bcd4-f408ef5c81cc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.975480] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-99eff37c-0811-4e54-bcd4-f408ef5c81cc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.975582] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99eff37c-0811-4e54-bcd4-f408ef5c81cc',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.019631] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.019953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.019953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.020156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.020253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.020458] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.020552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.020737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.020799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.020886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.020967] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 690.050074] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.050238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.050310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.050473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.050628] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.060016] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 690.477926] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.478248] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.478280] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.478551] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.478694] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.478844] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 99eff37c-0811-4e54-bcd4-f408ef5c81cc not found, creating... [ 690.479388] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.479606] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.479747] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.480017] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.480160] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.480434] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.480580] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.480687] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.480892] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.481033] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.481169] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 99eff37c-0811-4e54-bcd4-f408ef5c81cc is going to be created. [ 690.502279] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.502502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.502647] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.502980] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.503409] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.503460] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-99eff37c-0811-4e54-bcd4-f408ef5c81cc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.691201] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 690.691476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.691654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.692037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.692254] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.692382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.692472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.692836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.692836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.692980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.693172] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.693268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.693332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.693498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.693658] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.693761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.693820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.693968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.694062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.694174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.694231] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.695217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.695251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.695388] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.695488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.695613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.695812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.695894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.695984] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.198551] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.199500] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b563fa6-e694-4628-a9da-1beb0ee48864: rpc.has_security_group_logging(os_id): False [ 691.219717] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.220310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.220310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.220310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.220310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.220543] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.220614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.220644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.220793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.220866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.221146] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.221239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.221296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.221466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.221512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.221691] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.221801] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.221899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.222198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.222329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.222455] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be updated. [ 691.243308] env[66364]: INFO networking_nsxv3.common.synchronization [req-ca1e9389-069e-44d5-b54d-2673179a6e0e req-5ee8ee86-ad5e-48b2-8b8c-b7a2f5cc706d service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 691.243308] env[66364]: INFO networking_nsxv3.common.synchronization [req-ca1e9389-069e-44d5-b54d-2673179a6e0e req-5ee8ee86-ad5e-48b2-8b8c-b7a2f5cc706d service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 691.243308] env[66364]: INFO networking_nsxv3.common.synchronization [req-ca1e9389-069e-44d5-b54d-2673179a6e0e req-5ee8ee86-ad5e-48b2-8b8c-b7a2f5cc706d service nova] Enqueued Resource ID: 99eff37c-0811-4e54-bcd4-f408ef5c81cc with Priority: HIGHEST for action port [ 691.243565] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 in Status: SUCCESS [ 691.243565] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 deletion is rescheduled due to dependency. [ 691.243658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.244450] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 691.244450] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 691.244578] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99eff37c-0811-4e54-bcd4-f408ef5c81cc with Priority: HIGHEST for action port [ 691.245405] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.245592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.245592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.245948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.246990] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.250439] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.250439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.250439] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-99eff37c-0811-4e54-bcd4-f408ef5c81cc taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.250439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99eff37c-0811-4e54-bcd4-f408ef5c81cc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.250439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99eff37c-0811-4e54-bcd4-f408ef5c81cc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.250439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99eff37c-0811-4e54-bcd4-f408ef5c81cc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.250439] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99eff37c-0811-4e54-bcd4-f408ef5c81cc',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.292231] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.292488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.292488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.292813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.292993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.308041] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 691.703240] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.749497] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.749497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.757023] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99eff37c-0811-4e54-bcd4-f408ef5c81cc with status ACTIVE [ 691.757023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.757023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.757023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.757023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.757023] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99eff37c-0811-4e54-bcd4-f408ef5c81cc is going to be updated. [ 691.780207] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.780207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.780207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.780207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.780207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.780207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99eff37c-0811-4e54-bcd4-f408ef5c81cc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.073784] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 692.073968] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 deletion is rescheduled due to dependency. [ 692.074104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.074327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.074520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.074708] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.074824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.074888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.075064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.075160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.075252] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.205067] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.205286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.206330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.206330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.206330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.206330] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be updated. [ 692.243269] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.243443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.243506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.243729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.243875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.254177] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 692.326484] env[66364]: INFO networking_nsxv3.common.synchronization [req-fcf9dd60-c86c-4806-b227-f6f2a6b4eeee req-d2fc32d6-6a03-49ed-a565-d3cdeda74d23 tempest-InstanceActionsTestJSON-1055335036 tempest-InstanceActionsTestJSON-1055335036-project-member] Enqueued Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGHEST for action security_group_members [ 692.327278] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGHEST for action security_group_members [ 692.327524] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-395cdc70-30b6-4310-922a-3b2324c4a164 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.327706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.327781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.328057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.328349] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.328349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.328455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.328536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.328621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.328716] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395cdc70-30b6-4310-922a-3b2324c4a164',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.583150] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.723210] env[66364]: INFO networking_nsxv3.common.synchronization [None req-8308c03c-422e-42b2-9429-d25b24479933 None None] Enqueued Resource ID: bdd82d99-9b7f-41e5-bc86-baebd6fce905 with Priority: HIGHEST for action port [ 692.723210] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd82d99-9b7f-41e5-bc86-baebd6fce905 with Priority: HIGHEST for action port [ 692.724084] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdd82d99-9b7f-41e5-bc86-baebd6fce905 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.724547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdd82d99-9b7f-41e5-bc86-baebd6fce905" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.724704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdd82d99-9b7f-41e5-bc86-baebd6fce905" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.725056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdd82d99-9b7f-41e5-bc86-baebd6fce905" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.725250] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdd82d99-9b7f-41e5-bc86-baebd6fce905',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.766187] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-442 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.766187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-442" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.766187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-442" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.766187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-442" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.766187] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.766187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.766187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.766187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.766660] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.767038] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.767291] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.767525] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.767749] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.768072] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.768302] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.768570] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.791539] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.791988] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.791988] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.792137] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-442" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.792440] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-7e16c9ec-244d-4bab-b9ad-44898b02ff40 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.792605] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-7e16c9ec-244d-4bab-b9ad-44898b02ff40" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.792727] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-7e16c9ec-244d-4bab-b9ad-44898b02ff40" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.793324] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-7e16c9ec-244d-4bab-b9ad-44898b02ff40" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.793459] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e16c9ec-244d-4bab-b9ad-44898b02ff40',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.832446] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.832738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.832738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.834115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.834115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.834115] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.834115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.834115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.834115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.834115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.834115] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395cdc70-30b6-4310-922a-3b2324c4a164 already deleted. [ 692.834115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.085041] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.227430] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdd82d99-9b7f-41e5-bc86-baebd6fce905 [ 693.228126] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.228246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.228300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.228596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.228740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.228888] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdd82d99-9b7f-41e5-bc86-baebd6fce905 already deleted. [ 693.229038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdd82d99-9b7f-41e5-bc86-baebd6fce905" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.298933] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.299316] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.299515] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.299727] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.299922] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.300159] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 7e16c9ec-244d-4bab-b9ad-44898b02ff40 not found, creating... [ 693.300685] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.300803] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.300858] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.301168] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.301386] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.301710] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.301935] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.302086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.302338] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.302470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.302603] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 7e16c9ec-244d-4bab-b9ad-44898b02ff40 is going to be created. [ 693.325852] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 693.326094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.326431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.327333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.327484] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.329513] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.329682] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.329817] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.330098] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.330440] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.330730] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-7e16c9ec-244d-4bab-b9ad-44898b02ff40" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.587538] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.587762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.587856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.588181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.588811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.588940] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 693.625072] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.625737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.625737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.625737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.625737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.639197] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 693.833113] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.833469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.073057] env[66364]: INFO networking_nsxv3.common.synchronization [req-fcf9dd60-c86c-4806-b227-f6f2a6b4eeee req-ce0c22da-7cc4-477b-9648-75bffc141565 service nova] Enqueued Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGHEST for action security_group_rules [ 694.073233] env[66364]: INFO networking_nsxv3.common.synchronization [req-fcf9dd60-c86c-4806-b227-f6f2a6b4eeee req-ce0c22da-7cc4-477b-9648-75bffc141565 service nova] Enqueued Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGHEST for action security_group_members [ 694.073400] env[66364]: INFO networking_nsxv3.common.synchronization [req-fcf9dd60-c86c-4806-b227-f6f2a6b4eeee req-ce0c22da-7cc4-477b-9648-75bffc141565 service nova] Enqueued Resource ID: 7e16c9ec-244d-4bab-b9ad-44898b02ff40 with Priority: HIGHEST for action port [ 694.075522] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGHEST for action security_group_rules [ 694.075522] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGHEST for action security_group_members [ 694.075617] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e16c9ec-244d-4bab-b9ad-44898b02ff40 with Priority: HIGHEST for action port [ 694.077658] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395cdc70-30b6-4310-922a-3b2324c4a164 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.077658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.077658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.077658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.077658] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395cdc70-30b6-4310-922a-3b2324c4a164',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.077944] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-395cdc70-30b6-4310-922a-3b2324c4a164 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.077944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.077944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.078132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.078276] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.080533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.080533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.080533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.080533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.080533] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395cdc70-30b6-4310-922a-3b2324c4a164',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.081615] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e16c9ec-244d-4bab-b9ad-44898b02ff40 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.081615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e16c9ec-244d-4bab-b9ad-44898b02ff40" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.081615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e16c9ec-244d-4bab-b9ad-44898b02ff40" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.081615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e16c9ec-244d-4bab-b9ad-44898b02ff40" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.081615] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e16c9ec-244d-4bab-b9ad-44898b02ff40',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.275316] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 694.275633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.275815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.276066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.276270] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.276391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.276455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.276831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.276932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.277037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.277130] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.582992] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('395cdc70-30b6-4310-922a-3b2324c4a164',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.584468] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-395cdc70-30b6-4310-922a-3b2324c4a164 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.584468] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.584468] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e16c9ec-244d-4bab-b9ad-44898b02ff40 with status ACTIVE [ 694.584703] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.584768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.584813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.585129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.585129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.585271] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.585366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.585766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.585766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.585766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.585848] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.585997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.585997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.586230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.586322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.586386] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e16c9ec-244d-4bab-b9ad-44898b02ff40 is going to be updated. [ 694.610344] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.610500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.610575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.611069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.611249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.611424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e16c9ec-244d-4bab-b9ad-44898b02ff40" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.780285] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.780420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.780454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.780671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.780861] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.780971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.781048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.781212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.781304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.781394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.781547] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.781639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.781697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.781972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.782185] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.782300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.782427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.782604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.782693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.782863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.783057] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.088902] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('395cdc70-30b6-4310-922a-3b2324c4a164',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.287310] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b563fa6-e694-4628-a9da-1beb0ee48864: rpc.has_security_group_logging(os_id): False [ 695.319217] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.319513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.319513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.320216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.320216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.320216] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.320408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.320408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.320464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.320588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.320705] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.320798] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.320859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.321106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.321264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.321506] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.321603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.321690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.321963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.322015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.323100] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be updated. [ 695.407716] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.407871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.407932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.408152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.408300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.425136] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 695.512152] env[66364]: INFO networking_nsxv3.common.synchronization [None req-0381de46-e90f-4e7b-b181-deb22853038a None None] Enqueued Resource ID: fb3ee269-13b9-43ca-944f-4a1684469b60 with Priority: HIGHEST for action port [ 695.512747] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3ee269-13b9-43ca-944f-4a1684469b60 with Priority: HIGHEST for action port [ 695.513520] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb3ee269-13b9-43ca-944f-4a1684469b60 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.513676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb3ee269-13b9-43ca-944f-4a1684469b60" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.515642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb3ee269-13b9-43ca-944f-4a1684469b60" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.515642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb3ee269-13b9-43ca-944f-4a1684469b60" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.515642] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb3ee269-13b9-43ca-944f-4a1684469b60',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.591812] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.592607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.592607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.592607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.592607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.592607] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395cdc70-30b6-4310-922a-3b2324c4a164 is going to be created. [ 695.628487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.630045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.630045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.630045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.630220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.646302] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395cdc70-30b6-4310-922a-3b2324c4a164 in Status: UNINITIALIZED for 2s [ 695.651848] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 695.652073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.652222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.653730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.654066] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.654209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.654277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.654733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.654733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.654733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.654733] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.687598] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b6e9bae6-9b16-46af-8ccc-f53cf91f076d tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_rules [ 695.688534] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_rules [ 695.688635] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.688766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.688823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.689096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.689182] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.876696] env[66364]: INFO networking_nsxv3.common.synchronization [None req-4792dac6-654b-45fc-b69f-3bad8a2d0b3a tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_rules [ 695.877243] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_rules [ 695.877526] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.877632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.016421] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb3ee269-13b9-43ca-944f-4a1684469b60 [ 696.016721] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.016903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.016996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.017327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.017458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.017591] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb3ee269-13b9-43ca-944f-4a1684469b60 already deleted. [ 696.017701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb3ee269-13b9-43ca-944f-4a1684469b60" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.163328] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.163328] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.163328] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.163328] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.163328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.163971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.163971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.163971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.163971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.163971] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.226051] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.226051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.226051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.226051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.226051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.227228] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 already deleted. [ 696.227429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.228331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.228331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.228400] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.665810] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 784e3e36-fad9-4cd6-a173-77329b5f03c2: rpc.has_security_group_logging(os_id): False [ 696.687048] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.687276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.687901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.687901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.688041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.688239] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.688394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.688493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.688737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.688872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.689129] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.689385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.689385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.689466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.689496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.689688] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.689969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.690134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.690344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.690452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.690572] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 696.754854] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.754854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.755224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.755269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.755410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.755926] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 already deleted. [ 696.755926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.768066] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.768231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.768280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.768528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.768674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.784042] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 697.442051] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 697.442396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.655110] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395cdc70-30b6-4310-922a-3b2324c4a164 in Status: SUCCESS [ 697.655110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.655370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.655633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.656454] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.656672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.656747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.656924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.657012] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.657121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.657225] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('395cdc70-30b6-4310-922a-3b2324c4a164',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.766820] env[66364]: INFO networking_nsxv3.common.synchronization [req-a934f00b-f6aa-4ad5-81ef-70b8ae48097e req-4d6da19d-4158-49c6-aa73-7d440f038cdd tempest-ServerTagsTestJSON-1343586133 tempest-ServerTagsTestJSON-1343586133-project-member] Enqueued Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGHEST for action security_group_members [ 697.767410] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGHEST for action security_group_members [ 697.767700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.767816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.767884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.768292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.768456] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.768558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.768685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.768848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.768937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.769040] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a51a2156-9364-4e92-8d3f-5ecb8f11f0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.028268] env[66364]: INFO networking_nsxv3.common.synchronization [None req-9b5e24f5-26a0-4af6-b274-fa84aa98539f None None] Enqueued Resource ID: fa37351f-3a64-4843-95b7-d70ce4b03327 with Priority: HIGHEST for action port [ 698.029338] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa37351f-3a64-4843-95b7-d70ce4b03327 with Priority: HIGHEST for action port [ 698.029774] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa37351f-3a64-4843-95b7-d70ce4b03327 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.030083] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa37351f-3a64-4843-95b7-d70ce4b03327" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.031232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa37351f-3a64-4843-95b7-d70ce4b03327" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.031580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa37351f-3a64-4843-95b7-d70ce4b03327" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.031681] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa37351f-3a64-4843-95b7-d70ce4b03327',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.157711] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.158441] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-209" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.158578] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-209" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.158969] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-209" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.159314] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.159706] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.159885] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.160225] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.160370] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.160638] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.160779] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.160910] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.161053] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.161532] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.161532] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.161532] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.163057] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-395cdc70-30b6-4310-922a-3b2324c4a164 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.163249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.163359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.163502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.164071] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.164071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.164071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.164482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.164482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.164482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.164663] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-395cdc70-30b6-4310-922a-3b2324c4a164 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.164802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.164802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.165090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.165336] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.165428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.165428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.165642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.165748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.165840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.166022] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('395cdc70-30b6-4310-922a-3b2324c4a164',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.186043] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.186313] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.186495] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.186718] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-209" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.187164] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.187377] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.187529] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.187925] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.188111] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2289e58-c5ed-4f18-9628-1c500c4fd9e9',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.271643] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.272030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.272115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.272371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.272485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.272727] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.272831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.272892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.273099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.273183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.273269] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 already deleted. [ 698.273364] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.537063] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa37351f-3a64-4843-95b7-d70ce4b03327 [ 698.537404] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.537464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.537499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.538105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.538105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.538105] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa37351f-3a64-4843-95b7-d70ce4b03327 already deleted. [ 698.538105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa37351f-3a64-4843-95b7-d70ce4b03327" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.669019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 395cdc70-30b6-4310-922a-3b2324c4a164: rpc.has_security_group_logging(os_id): False [ 698.689339] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.689511] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.689715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.689851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.689945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.690199] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.690314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.690573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.690573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.690653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.690917] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.691044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.691148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.691310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.691400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.691562] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.692589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.692589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.692589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.692589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.692589] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395cdc70-30b6-4310-922a-3b2324c4a164 is going to be created. [ 698.693434] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.693620] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.693711] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.693935] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.694047] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.694187] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port e2289e58-c5ed-4f18-9628-1c500c4fd9e9 not found, creating... [ 698.694791] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.697145] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.697145] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.697282] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.697391] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.697789] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.697877] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.699065] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.699065] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.699065] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.699065] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: e2289e58-c5ed-4f18-9628-1c500c4fd9e9 is going to be created. [ 698.719941] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.720414] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.720414] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.720658] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.720767] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.720989] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.758202] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.758586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.760609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.760609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.760609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.774952] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395cdc70-30b6-4310-922a-3b2324c4a164 in Status: IN_PROGRESS for 2s [ 698.820127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 698.820127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.513789] env[66364]: INFO networking_nsxv3.common.synchronization [req-a934f00b-f6aa-4ad5-81ef-70b8ae48097e req-7257115a-5387-4692-b59b-57286566c86d service nova] Enqueued Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGHEST for action security_group_rules [ 699.515575] env[66364]: INFO networking_nsxv3.common.synchronization [req-a934f00b-f6aa-4ad5-81ef-70b8ae48097e req-7257115a-5387-4692-b59b-57286566c86d service nova] Enqueued Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGHEST for action security_group_members [ 699.518054] env[66364]: INFO networking_nsxv3.common.synchronization [req-a934f00b-f6aa-4ad5-81ef-70b8ae48097e req-7257115a-5387-4692-b59b-57286566c86d service nova] Enqueued Resource ID: e2289e58-c5ed-4f18-9628-1c500c4fd9e9 with Priority: HIGHEST for action port [ 699.522019] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGHEST for action security_group_rules [ 699.522019] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGHEST for action security_group_members [ 699.522019] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2289e58-c5ed-4f18-9628-1c500c4fd9e9 with Priority: HIGHEST for action port [ 699.522019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.522019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a51a2156-9364-4e92-8d3f-5ecb8f11f0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.522019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.522019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.522019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.522019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a51a2156-9364-4e92-8d3f-5ecb8f11f0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.522019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.523051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.523295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.523517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.523669] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2289e58-c5ed-4f18-9628-1c500c4fd9e9',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.658075] env[66364]: INFO networking_nsxv3.common.synchronization [None req-039b6524-c0b3-4607-8869-e67679625235 tempest-MigrationsAdminTest-172536833 tempest-MigrationsAdminTest-172536833-project-member] Enqueued Resource ID: c306d842-409e-4391-b442-a9ab86532e10 with Priority: HIGHEST for action security_group_rules [ 699.658520] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c306d842-409e-4391-b442-a9ab86532e10 with Priority: HIGHEST for action security_group_rules [ 699.659258] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c306d842-409e-4391-b442-a9ab86532e10 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.659258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c306d842-409e-4391-b442-a9ab86532e10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.659258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c306d842-409e-4391-b442-a9ab86532e10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.660902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c306d842-409e-4391-b442-a9ab86532e10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.660902] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c306d842-409e-4391-b442-a9ab86532e10',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.758120] env[66364]: INFO networking_nsxv3.common.synchronization [None req-2b4648c3-0343-4117-8638-c9bee34a32a0 tempest-AttachVolumeShelveTestJSON-446961995 tempest-AttachVolumeShelveTestJSON-446961995-project-member] Enqueued Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_rules [ 699.758555] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_rules [ 699.758805] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.758924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.758998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.759921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.760041] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.849907] env[66364]: INFO networking_nsxv3.common.synchronization [None req-9d2d16cc-ff9c-4d75-993f-13592e9064e6 tempest-MigrationsAdminTest-172536833 tempest-MigrationsAdminTest-172536833-project-member] Enqueued Resource ID: c306d842-409e-4391-b442-a9ab86532e10 with Priority: HIGHEST for action security_group_rules [ 699.850058] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c306d842-409e-4391-b442-a9ab86532e10 with Priority: HIGHEST for action security_group_rules [ 699.850414] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c306d842-409e-4391-b442-a9ab86532e10 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.850528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c306d842-409e-4391-b442-a9ab86532e10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.926510] env[66364]: INFO networking_nsxv3.common.synchronization [None req-525bd47b-2476-45a2-8a3f-2c58d822f86b tempest-AttachVolumeShelveTestJSON-446961995 tempest-AttachVolumeShelveTestJSON-446961995-project-member] Enqueued Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_rules [ 699.927218] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_rules [ 699.927439] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.927587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.030095] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a51a2156-9364-4e92-8d3f-5ecb8f11f0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.031825] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.031998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.035636] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2289e58-c5ed-4f18-9628-1c500c4fd9e9 with status ACTIVE [ 700.035636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.035636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.035636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.035636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.035636] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2289e58-c5ed-4f18-9628-1c500c4fd9e9 is going to be updated. [ 700.058268] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.058448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.058530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.058741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.058885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.059061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2289e58-c5ed-4f18-9628-1c500c4fd9e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.191199] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.191443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.191443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.192101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.192228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.192307] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c306d842-409e-4391-b442-a9ab86532e10 already deleted. [ 700.192393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c306d842-409e-4391-b442-a9ab86532e10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.192571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c306d842-409e-4391-b442-a9ab86532e10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.192757] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c306d842-409e-4391-b442-a9ab86532e10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.192843] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c306d842-409e-4391-b442-a9ab86532e10',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.294311] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.294311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.294311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.294311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.294311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.294311] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0345151-3287-4add-b6b3-bbb72460c6bd already deleted. [ 700.294311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.294311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.294311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.294311] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.533745] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a51a2156-9364-4e92-8d3f-5ecb8f11f0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.717505] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.717505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.717505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.717505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.717505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.717505] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c306d842-409e-4391-b442-a9ab86532e10 already deleted. [ 700.717505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c306d842-409e-4391-b442-a9ab86532e10" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.870868] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 395cdc70-30b6-4310-922a-3b2324c4a164 in Status: SUCCESS [ 700.871161] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.911227] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.911227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.911227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.911227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.911227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.911227] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0345151-3287-4add-b6b3-bbb72460c6bd already deleted. [ 700.911227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.036023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.036212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.036285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.036522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.036662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.036772] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 is going to be created. [ 701.062385] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.063352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.063352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.063352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.063352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.074641] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 in Status: UNINITIALIZED for 2s [ 701.132813] env[66364]: INFO networking_nsxv3.common.synchronization [None req-5dcd7614-0a85-4a03-ab16-bf7b1dbcc4d6 None None] Enqueued Resource ID: c31ae2ae-544a-4e31-9da7-d9c658b5f4c7 with Priority: HIGHEST for action port [ 701.133536] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c31ae2ae-544a-4e31-9da7-d9c658b5f4c7 with Priority: HIGHEST for action port [ 701.133851] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c31ae2ae-544a-4e31-9da7-d9c658b5f4c7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.133971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c31ae2ae-544a-4e31-9da7-d9c658b5f4c7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.134109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c31ae2ae-544a-4e31-9da7-d9c658b5f4c7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.134443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c31ae2ae-544a-4e31-9da7-d9c658b5f4c7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.134536] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c31ae2ae-544a-4e31-9da7-d9c658b5f4c7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.636871] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c31ae2ae-544a-4e31-9da7-d9c658b5f4c7 [ 701.637859] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.637859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.638082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.638774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.638774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.638774] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c31ae2ae-544a-4e31-9da7-d9c658b5f4c7 already deleted. [ 701.638774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c31ae2ae-544a-4e31-9da7-d9c658b5f4c7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.001493] env[66364]: INFO networking_nsxv3.common.synchronization [req-7f35ba81-5991-4fa4-9e96-46c78bc68790 req-496415a3-16f7-41e1-9623-6e9de4618c6d tempest-ServersTestManualDisk-297421654 tempest-ServersTestManualDisk-297421654-project-member] Enqueued Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_members [ 703.002181] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_members [ 703.002709] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a59a352e-2737-4849-9aff-a8ce9ffcd13d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.002709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.002837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.003112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.003450] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.003450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.003571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.004828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.004951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.005593] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.094228] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 in Status: SUCCESS [ 703.094228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.094228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.094228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.094228] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.094228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.094228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.094228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.094228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.094228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.094228] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a51a2156-9364-4e92-8d3f-5ecb8f11f0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.508838] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.509506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.509506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.509506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.509696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.510317] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.510317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.510317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.510317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.510516] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.510516] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d already deleted. [ 703.510592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.557862] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.558081] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-202" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.558229] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-202" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.558603] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-202" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.559184] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.559184] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.559323] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.559462] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.559614] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.560020] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.560205] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.560316] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.560442] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.560554] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.560672] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.560992] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.589408] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.589618] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.589778] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.590746] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-202" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.590746] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-d5641d6a-a71b-458e-a59b-0658e9319d83 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.590746] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-d5641d6a-a71b-458e-a59b-0658e9319d83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.590982] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-d5641d6a-a71b-458e-a59b-0658e9319d83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.591185] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-d5641d6a-a71b-458e-a59b-0658e9319d83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.591345] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5641d6a-a71b-458e-a59b-0658e9319d83',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.598742] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.598903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.598975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.599202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.599861] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.599861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.599861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.599861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.599861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.600222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.600222] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.600320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.600320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.600441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.600580] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.601873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.601873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.601873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.601873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.601873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.601873] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a51a2156-9364-4e92-8d3f-5ecb8f11f0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.094433] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.094775] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.094775] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.095120] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.095238] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.095389] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port d5641d6a-a71b-458e-a59b-0658e9319d83 not found, creating... [ 704.095633] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.095803] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.095916] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.096172] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.096324] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.096611] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.096759] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.096868] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.097152] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.097302] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.097438] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: d5641d6a-a71b-458e-a59b-0658e9319d83 is going to be created. [ 704.107562] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a51a2156-9364-4e92-8d3f-5ecb8f11f0f8: rpc.has_security_group_logging(os_id): False [ 704.118654] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.118925] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.119071] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.119347] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.119565] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.119771] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-d5641d6a-a71b-458e-a59b-0658e9319d83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.126951] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.127116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.127213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.127392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.127451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.127639] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.127779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.127779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.127932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.128016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.128211] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.128295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.128435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.128553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.128553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.128735] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.128824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.128882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.129045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.129120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.129203] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 is going to be created. [ 704.220195] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.220353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.220353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.220680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.221518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.238159] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 in Status: IN_PROGRESS for 2s [ 704.898399] env[66364]: INFO networking_nsxv3.common.synchronization [req-7f35ba81-5991-4fa4-9e96-46c78bc68790 req-1dbdef7b-53e6-41dd-9eef-6abc77d9e1bb service nova] Enqueued Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_rules [ 704.898399] env[66364]: INFO networking_nsxv3.common.synchronization [req-7f35ba81-5991-4fa4-9e96-46c78bc68790 req-1dbdef7b-53e6-41dd-9eef-6abc77d9e1bb service nova] Enqueued Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_members [ 704.898504] env[66364]: INFO networking_nsxv3.common.synchronization [req-7f35ba81-5991-4fa4-9e96-46c78bc68790 req-1dbdef7b-53e6-41dd-9eef-6abc77d9e1bb service nova] Enqueued Resource ID: d5641d6a-a71b-458e-a59b-0658e9319d83 with Priority: HIGHEST for action port [ 704.899046] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_rules [ 704.899180] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_members [ 704.899390] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5641d6a-a71b-458e-a59b-0658e9319d83 with Priority: HIGHEST for action port [ 704.901216] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.901361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.901428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.901664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.901723] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.903087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a59a352e-2737-4849-9aff-a8ce9ffcd13d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.903211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.903310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.903533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.903727] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.903771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.903828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.904020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.904117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.904209] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.905198] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5641d6a-a71b-458e-a59b-0658e9319d83 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.905294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5641d6a-a71b-458e-a59b-0658e9319d83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.907465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5641d6a-a71b-458e-a59b-0658e9319d83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.907465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5641d6a-a71b-458e-a59b-0658e9319d83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.907465] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5641d6a-a71b-458e-a59b-0658e9319d83',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.012979] env[66364]: INFO networking_nsxv3.common.synchronization [req-bce6dde9-29a1-4a1d-b92b-f899f0674508 req-e0c37ab6-f2e2-4179-afd2-e2a72a6b9c8e tempest-FloatingIPsAssociationNegativeTestJSON-1552793735 tempest-FloatingIPsAssociationNegativeTestJSON-1552793735-project-member] Enqueued Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGHEST for action security_group_members [ 705.014496] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGHEST for action security_group_members [ 705.014496] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b09036d-f422-41d0-af9e-74fbcbfb71a6 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.014496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.014496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.014814] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.015086] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.015086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.015190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.015332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.015465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.015528] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b09036d-f422-41d0-af9e-74fbcbfb71a6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.410439] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.412859] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a59a352e-2737-4849-9aff-a8ce9ffcd13d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.412859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.412859] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5641d6a-a71b-458e-a59b-0658e9319d83 with status ACTIVE [ 705.412859] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.412859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.412859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.412859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.412859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.412859] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.412859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.412859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.413257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.413257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.413257] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.413358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.413358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.413546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.413600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.413670] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5641d6a-a71b-458e-a59b-0658e9319d83 is going to be updated. [ 705.442647] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.442740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.442740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.444100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.444100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.444100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5641d6a-a71b-458e-a59b-0658e9319d83" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.519123] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.519123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.519123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.519361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.519599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.520180] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.520180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.520180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.520335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.520335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.520952] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 is going to be updated. [ 705.565855] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.565855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.565855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.565855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.565855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.575389] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 in Status: IN_PROGRESS for 2s [ 705.918519] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.254487] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 in Status: SUCCESS [ 706.254664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.420015] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.420624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.420624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.420624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.420624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.420624] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d is going to be created. [ 706.455381] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.455476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.455513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.455731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.455900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.470486] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d in Status: UNINITIALIZED for 2s [ 706.501529] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b519708d-831e-471d-9dc2-2c4d59a15256 None None] Enqueued Resource ID: 39dbd33a-8ec5-4961-a81b-2cd5b92ed242 with Priority: HIGHEST for action port [ 706.501884] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39dbd33a-8ec5-4961-a81b-2cd5b92ed242 with Priority: HIGHEST for action port [ 706.502496] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-39dbd33a-8ec5-4961-a81b-2cd5b92ed242 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.502615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39dbd33a-8ec5-4961-a81b-2cd5b92ed242" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.502615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39dbd33a-8ec5-4961-a81b-2cd5b92ed242" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.502895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39dbd33a-8ec5-4961-a81b-2cd5b92ed242" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.502976] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39dbd33a-8ec5-4961-a81b-2cd5b92ed242',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.005449] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39dbd33a-8ec5-4961-a81b-2cd5b92ed242 [ 707.005691] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.006045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.006123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.006339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.006496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.006590] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39dbd33a-8ec5-4961-a81b-2cd5b92ed242 already deleted. [ 707.006676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39dbd33a-8ec5-4961-a81b-2cd5b92ed242" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.305980] env[66364]: INFO networking_nsxv3.common.synchronization [None req-dd9517d3-30e9-4816-8175-4511e5cb0a43 None None] Enqueued Resource ID: 51a14caf-4412-41a2-86b9-8a085a476fb7 with Priority: HIGHEST for action port [ 707.306770] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51a14caf-4412-41a2-86b9-8a085a476fb7 with Priority: HIGHEST for action port [ 707.306943] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-51a14caf-4412-41a2-86b9-8a085a476fb7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.307021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51a14caf-4412-41a2-86b9-8a085a476fb7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.307171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51a14caf-4412-41a2-86b9-8a085a476fb7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.309785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51a14caf-4412-41a2-86b9-8a085a476fb7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.309785] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51a14caf-4412-41a2-86b9-8a085a476fb7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.311413] env[66364]: INFO networking_nsxv3.common.synchronization [req-57fdd1dd-24e9-4575-bda7-cc5326428050 req-e3b20b08-89d8-4241-8e0c-09a322d5f570 tempest-FloatingIPsAssociationTestJSON-640590749 tempest-FloatingIPsAssociationTestJSON-640590749-project-member] Enqueued Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 707.312578] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 707.312578] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.312578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.312762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.312877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.312938] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.313054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.313124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.313292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.315595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.315595] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.589072] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 in Status: SUCCESS [ 707.589072] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 deletion is rescheduled due to dependency. [ 707.589072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.813232] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51a14caf-4412-41a2-86b9-8a085a476fb7 [ 707.813232] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.813232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.813232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.813678] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.813678] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.813758] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51a14caf-4412-41a2-86b9-8a085a476fb7 already deleted. [ 707.813835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51a14caf-4412-41a2-86b9-8a085a476fb7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.816969] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.320215] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.481908] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d in Status: SUCCESS [ 708.482199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.482530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.482833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.483799] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.483799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.483799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.483799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.483799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.483799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.483799] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.825539] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.825539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.825539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.825539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.825539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.825539] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 is going to be updated. [ 708.860143] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.860285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.860359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.860582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.860733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.873251] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: IN_PROGRESS for 2s [ 708.988672] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.307821] env[66364]: INFO networking_nsxv3.common.synchronization [None req-76fbdbcb-f177-4917-947a-fe31217026ab None None] Enqueued Resource ID: d1233589-97b3-4bd7-aa41-fa8885a62d22 with Priority: HIGHEST for action port [ 709.308596] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1233589-97b3-4bd7-aa41-fa8885a62d22 with Priority: HIGHEST for action port [ 709.308906] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1233589-97b3-4bd7-aa41-fa8885a62d22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.310057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1233589-97b3-4bd7-aa41-fa8885a62d22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.310566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1233589-97b3-4bd7-aa41-fa8885a62d22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.310566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1233589-97b3-4bd7-aa41-fa8885a62d22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.310566] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1233589-97b3-4bd7-aa41-fa8885a62d22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.492706] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a59a352e-2737-4849-9aff-a8ce9ffcd13d: rpc.has_security_group_logging(os_id): False [ 709.514847] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.514847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.514847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.514847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.515760] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.516165] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.516313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.516381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.517208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.517297] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.517376] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d is going to be created. [ 709.623131] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.623464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.623633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.623939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.624296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.641131] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d in Status: IN_PROGRESS for 2s [ 709.814377] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1233589-97b3-4bd7-aa41-fa8885a62d22 [ 709.814684] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.814836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.814929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.815213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.815331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.815438] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1233589-97b3-4bd7-aa41-fa8885a62d22 already deleted. [ 709.815541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1233589-97b3-4bd7-aa41-fa8885a62d22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.020436] env[66364]: INFO networking_nsxv3.common.synchronization [None req-5ee28d66-ade8-4566-ac66-ea07c1766f56 tempest-ServersTestJSON-1686957391 tempest-ServersTestJSON-1686957391-project-member] Enqueued Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_rules [ 710.021063] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_rules [ 710.021273] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.021443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.021474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.021696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.021779] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.439446] env[66364]: INFO networking_nsxv3.common.synchronization [req-c6151f02-d820-423c-92c3-5e0e20381aa3 req-2051a266-b8c7-4a25-a061-2b40d4280384 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 710.440079] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 710.440319] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.440441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.440516] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.440788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.440949] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.442126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.442492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.442492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.442492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.442608] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.456704] env[66364]: INFO networking_nsxv3.common.synchronization [None req-d6f22d5b-2700-4c0a-9612-8cfba3aa29d4 None None] Enqueued Resource ID: 7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d with Priority: HIGHEST for action port [ 710.457929] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d with Priority: HIGHEST for action port [ 710.457929] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.457929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.457929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.457929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.457929] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.546112] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.546112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.546112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.546112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.546112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.546112] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 already deleted. [ 710.546112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.602634] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b7fc85f3-c57b-464a-990e-9558f110457f tempest-ServersTestJSON-1686957391 tempest-ServersTestJSON-1686957391-project-member] Enqueued Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_rules [ 710.605800] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_rules [ 710.606685] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.606843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.606931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.607178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.607266] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.830186] env[66364]: INFO networking_nsxv3.common.synchronization [None req-091e52dd-cfba-4e8e-9322-d443fe938184 None None] Enqueued Resource ID: 6b4935bc-447a-4606-b185-1dcffe66e6a7 with Priority: HIGHEST for action port [ 710.830186] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b4935bc-447a-4606-b185-1dcffe66e6a7 with Priority: HIGHEST for action port [ 710.830186] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b4935bc-447a-4606-b185-1dcffe66e6a7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.830186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b4935bc-447a-4606-b185-1dcffe66e6a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.830186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b4935bc-447a-4606-b185-1dcffe66e6a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.830186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b4935bc-447a-4606-b185-1dcffe66e6a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.830186] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4935bc-447a-4606-b185-1dcffe66e6a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.887566] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: SUCCESS [ 710.888189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.926113] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-319 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.926407] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.926577] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.926951] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.931064] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.931064] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.931284] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.934908] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.934908] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.934908] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.934908] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.934908] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.934908] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.934908] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.934908] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.934908] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.944797] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.944972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.945052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.945279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.945367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.945560] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.945650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.945708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.946165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.946367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.946509] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c000df34-07b2-4015-b824-73615ee8d750 already deleted. [ 710.947252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.963993] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d [ 710.964470] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.964696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.965657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.965657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.965657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.965657] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d already deleted. [ 710.965657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cdc345f-d71e-4e2e-a5a8-c0f1d0a3360d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.992294] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.992417] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.060 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.992548] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.992721] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.993187] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.993304] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.993432] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.993738] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.993920] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01eff259-59a1-4b9b-9cdf-a61fa00dd1f2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.127804] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.127804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.128203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.128203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.128203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.128309] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 already deleted. [ 711.128415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.334946] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b4935bc-447a-4606-b185-1dcffe66e6a7 [ 711.334946] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.334946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.334946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.334946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.334946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.334946] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b4935bc-447a-4606-b185-1dcffe66e6a7 already deleted. [ 711.334946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b4935bc-447a-4606-b185-1dcffe66e6a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.496779] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.497697] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.497844] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.501023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.501023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.501023] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 01eff259-59a1-4b9b-9cdf-a61fa00dd1f2 not found, creating... [ 711.501023] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.501023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.501023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.501023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.501023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.501023] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.501502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.501754] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.502462] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.503070] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.503362] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 01eff259-59a1-4b9b-9cdf-a61fa00dd1f2 is going to be created. [ 711.529037] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.529037] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.529037] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.529037] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.529037] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.529037] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.655527] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d in Status: SUCCESS [ 711.655527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.207017] env[66364]: INFO networking_nsxv3.common.synchronization [req-c6151f02-d820-423c-92c3-5e0e20381aa3 req-9d95eefb-633b-4d09-8d1a-a9052672ec56 service nova] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_rules [ 712.207017] env[66364]: INFO networking_nsxv3.common.synchronization [req-c6151f02-d820-423c-92c3-5e0e20381aa3 req-9d95eefb-633b-4d09-8d1a-a9052672ec56 service nova] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 712.207017] env[66364]: INFO networking_nsxv3.common.synchronization [req-c6151f02-d820-423c-92c3-5e0e20381aa3 req-9d95eefb-633b-4d09-8d1a-a9052672ec56 service nova] Enqueued Resource ID: 01eff259-59a1-4b9b-9cdf-a61fa00dd1f2 with Priority: HIGHEST for action port [ 712.207664] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_rules [ 712.207837] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 712.207904] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01eff259-59a1-4b9b-9cdf-a61fa00dd1f2 with Priority: HIGHEST for action port [ 712.208229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.208358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.208423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.208683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.208771] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.210558] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.210839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.210923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.211241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.211397] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.212536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.212536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.212536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.212536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.212536] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.213636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.213703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.214054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.214153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.214213] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01eff259-59a1-4b9b-9cdf-a61fa00dd1f2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.716096] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.716620] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.716755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.716908] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01eff259-59a1-4b9b-9cdf-a61fa00dd1f2 with status ACTIVE [ 712.717152] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.717223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.717223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.717476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.717565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.717739] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.719026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.719026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.719026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.719026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.719026] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.719026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.719026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.719026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.719026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.719026] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01eff259-59a1-4b9b-9cdf-a61fa00dd1f2 is going to be updated. [ 712.742456] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.742607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.742671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.742882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.743037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.743201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01eff259-59a1-4b9b-9cdf-a61fa00dd1f2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.222994] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.727470] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.727632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.727688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.728108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.728108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.728108] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c000df34-07b2-4015-b824-73615ee8d750 is going to be created. [ 713.754825] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.754967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.755048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.755260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.755415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.770186] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: UNINITIALIZED for 2s [ 713.817178] env[66364]: INFO networking_nsxv3.common.synchronization [None req-85c403f0-d152-413f-8553-02adbb88edbb None None] Enqueued Resource ID: 9ffb6ffe-401f-43c3-8ffd-20222832397e with Priority: HIGHEST for action port [ 713.818019] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ffb6ffe-401f-43c3-8ffd-20222832397e with Priority: HIGHEST for action port [ 713.819499] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ffb6ffe-401f-43c3-8ffd-20222832397e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.819499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ffb6ffe-401f-43c3-8ffd-20222832397e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.819499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ffb6ffe-401f-43c3-8ffd-20222832397e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.819499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ffb6ffe-401f-43c3-8ffd-20222832397e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.819499] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ffb6ffe-401f-43c3-8ffd-20222832397e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.322469] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ffb6ffe-401f-43c3-8ffd-20222832397e [ 714.322469] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.322469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.322469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.322469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.322469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.322469] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ffb6ffe-401f-43c3-8ffd-20222832397e already deleted. [ 714.322469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ffb6ffe-401f-43c3-8ffd-20222832397e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.788517] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: SUCCESS [ 715.788517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.788517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.788517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.788517] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.788517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.788517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.788517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.788517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.788517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.788517] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.292619] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.292791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.292863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.293153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.293336] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.293427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.293508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.293696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.293802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.293841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.294173] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.294260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.294372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.294472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.294642] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.294777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.294777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.294922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.294993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.295087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.295178] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.798071] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c000df34-07b2-4015-b824-73615ee8d750: rpc.has_security_group_logging(os_id): False [ 716.821745] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.821907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.821954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.822278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.822376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.822566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.822668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.822728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.822880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.822955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.823181] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.823277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.823337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.823480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.823552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.823723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.823813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.823872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.824013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.825156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.825250] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c000df34-07b2-4015-b824-73615ee8d750 is going to be created. [ 716.887155] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.887155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.887155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.887155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.887155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.900374] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: IN_PROGRESS for 2s [ 718.428932] env[66364]: INFO networking_nsxv3.common.synchronization [None req-9425d328-71dc-4141-a0d9-16b074719eae tempest-ImagesOneServerNegativeTestJSON-519635427 tempest-ImagesOneServerNegativeTestJSON-519635427-project-member] Enqueued Resource ID: e3cc037d-c327-4499-9ef7-23b689bb7da2 with Priority: HIGHEST for action security_group_rules [ 718.429564] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cc037d-c327-4499-9ef7-23b689bb7da2 with Priority: HIGHEST for action security_group_rules [ 718.429891] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3cc037d-c327-4499-9ef7-23b689bb7da2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.430183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3cc037d-c327-4499-9ef7-23b689bb7da2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.430183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3cc037d-c327-4499-9ef7-23b689bb7da2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.430389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3cc037d-c327-4499-9ef7-23b689bb7da2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.430452] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3cc037d-c327-4499-9ef7-23b689bb7da2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.562498] env[66364]: INFO networking_nsxv3.common.synchronization [None req-9d50c740-378b-4a7b-8991-8d1ac3b6dd3c tempest-ImagesOneServerNegativeTestJSON-519635427 tempest-ImagesOneServerNegativeTestJSON-519635427-project-member] Enqueued Resource ID: e3cc037d-c327-4499-9ef7-23b689bb7da2 with Priority: HIGHEST for action security_group_rules [ 718.562756] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3cc037d-c327-4499-9ef7-23b689bb7da2 with Priority: HIGHEST for action security_group_rules [ 718.563534] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3cc037d-c327-4499-9ef7-23b689bb7da2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.563653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3cc037d-c327-4499-9ef7-23b689bb7da2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.916660] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: SUCCESS [ 718.916940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.952766] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.952766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.952766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.953066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.953272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.953272] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3cc037d-c327-4499-9ef7-23b689bb7da2 already deleted. [ 718.953409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3cc037d-c327-4499-9ef7-23b689bb7da2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.953456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3cc037d-c327-4499-9ef7-23b689bb7da2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.955365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3cc037d-c327-4499-9ef7-23b689bb7da2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.955365] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3cc037d-c327-4499-9ef7-23b689bb7da2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.479984] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.481830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.481830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.481830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.482035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.482035] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3cc037d-c327-4499-9ef7-23b689bb7da2 already deleted. [ 719.482207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3cc037d-c327-4499-9ef7-23b689bb7da2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.732403] env[66364]: INFO networking_nsxv3.common.synchronization [req-07c40f73-0a37-48c4-aa32-2e3d08ed464c req-4a3029f1-c491-4fbc-9aff-1cbe67a9f515 tempest-InstanceActionsTestJSON-1055335036 tempest-InstanceActionsTestJSON-1055335036-project-member] Enqueued Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGHEST for action security_group_members [ 719.733027] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGHEST for action security_group_members [ 719.734126] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-395cdc70-30b6-4310-922a-3b2324c4a164 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.734905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.734905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.734905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.734905] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.735168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.735168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.735918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.735918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.735918] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('395cdc70-30b6-4310-922a-3b2324c4a164',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.238644] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.239122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.239195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.239420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.239511] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.239721] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.239816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.239876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.242119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.242119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.242119] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395cdc70-30b6-4310-922a-3b2324c4a164 is going to be updated. [ 720.249607] env[66364]: INFO networking_nsxv3.common.synchronization [req-a9abef69-9e7b-477c-8f62-03cbd832802a req-ce56d6e5-46f7-49bc-bc29-5b142a822bdd tempest-ListServersNegativeTestJSON-713481304 tempest-ListServersNegativeTestJSON-713481304-project-member] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 720.250356] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 720.250692] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.250831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.250898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.251132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.251315] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.251414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.251487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.251667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.251791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.251884] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.274803] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.275217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.275489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.275782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.277017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.287204] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395cdc70-30b6-4310-922a-3b2324c4a164 in Status: IN_PROGRESS for 2s [ 720.753985] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.860018] env[66364]: INFO networking_nsxv3.common.synchronization [req-12c67f87-5d51-4efb-a1d0-054f88e64960 req-e5ffeb3a-089c-4978-ad03-10a7989c5c9b tempest-ServersTestBootFromVolume-733094098 tempest-ServersTestBootFromVolume-733094098-project-member] Enqueued Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_members [ 720.860911] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGHEST for action security_group_members [ 720.861820] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-02c59c8a-da67-420a-8de3-ef613658b83d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.861957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.862034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.862296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.862513] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.862609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.862671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.862876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.863061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.863168] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.008716] env[66364]: INFO networking_nsxv3.common.synchronization [None req-13ee69bb-f430-4337-be2d-5c509a12fefc None None] Enqueued Resource ID: 8ffc5b04-03f5-4645-bfc5-a2e797beaf2c with Priority: HIGHEST for action port [ 721.010533] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ffc5b04-03f5-4645-bfc5-a2e797beaf2c with Priority: HIGHEST for action port [ 721.011382] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ffc5b04-03f5-4645-bfc5-a2e797beaf2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.011590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ffc5b04-03f5-4645-bfc5-a2e797beaf2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.011680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ffc5b04-03f5-4645-bfc5-a2e797beaf2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.012223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ffc5b04-03f5-4645-bfc5-a2e797beaf2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.012223] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ffc5b04-03f5-4645-bfc5-a2e797beaf2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.259023] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.366537] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.366693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.366780] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.366993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.367111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.367516] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.367644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.367709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.368504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.368504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.368504] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02c59c8a-da67-420a-8de3-ef613658b83d is going to be updated. [ 721.399691] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.399859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.400697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.400697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.400697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.405502] env[66364]: INFO networking_nsxv3.common.synchronization [req-dda61a2d-358f-4138-bbec-d1801565890f req-b5b48764-56e1-45f9-8202-d669f3377e44 tempest-ListServersNegativeTestJSON-713481304 tempest-ListServersNegativeTestJSON-713481304-project-member] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 721.405502] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGHEST for action security_group_members [ 721.405502] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.405502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.414428] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02c59c8a-da67-420a-8de3-ef613658b83d in Status: IN_PROGRESS for 2s [ 721.516422] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ffc5b04-03f5-4645-bfc5-a2e797beaf2c [ 721.517155] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.517155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.517155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.517565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.517877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.517877] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ffc5b04-03f5-4645-bfc5-a2e797beaf2c already deleted. [ 721.517969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ffc5b04-03f5-4645-bfc5-a2e797beaf2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.760745] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.761231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.761371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.761626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.761750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.763454] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be updated. [ 721.799681] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.799681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.799681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.799681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.799681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.811640] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 722.016493] env[66364]: INFO networking_nsxv3.common.synchronization [req-119f9fdd-2739-4385-9c2a-514637b7a003 req-698b02d4-7acb-485c-9d20-06f06e82524c tempest-ServersAdminNegativeTestJSON-1819478050 tempest-ServersAdminNegativeTestJSON-1819478050-project-member] Enqueued Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 722.018341] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 722.019308] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.019455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.019522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.019786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.021547] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.021766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.021817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.022014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.022123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.022237] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.298623] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 395cdc70-30b6-4310-922a-3b2324c4a164 in Status: SUCCESS [ 722.298846] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 395cdc70-30b6-4310-922a-3b2324c4a164 deletion is rescheduled due to dependency. [ 722.298937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.470893] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.470893] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.470893] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.470893] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.471340] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.471340] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.471340] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.471552] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.471695] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.471838] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.471939] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.472051] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.472177] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.472305] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.472406] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.472530] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.497085] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.497349] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.497739] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.497777] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.498260] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-10a428b2-f60a-482b-a4fb-6fa593578292 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.498506] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-10a428b2-f60a-482b-a4fb-6fa593578292" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.498722] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-10a428b2-f60a-482b-a4fb-6fa593578292" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.499294] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-10a428b2-f60a-482b-a4fb-6fa593578292" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.499488] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10a428b2-f60a-482b-a4fb-6fa593578292',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.528832] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.529051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.529156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.529607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.530246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.530246] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.530920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.531048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.531245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.531336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.531423] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007f96f6-a408-4a76-b5c6-eceae8238916 already deleted. [ 722.531500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.954307] env[66364]: INFO networking_nsxv3.common.synchronization [req-66b89dcc-866e-43af-9ca3-d7c5a7dfe99c req-18039670-1d3e-4270-9142-a7a342b66836 tempest-VolumesAssistedSnapshotsTest-1793212956 tempest-VolumesAssistedSnapshotsTest-1793212956-project-member] Enqueued Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_members [ 722.954663] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 with Priority: HIGHEST for action security_group_members [ 722.955281] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.955281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.955281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.955501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.955501] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.955595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.955647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.955827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.955908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.956024] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.003028] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.003281] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.003460] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.003772] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.003922] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.004184] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 10a428b2-f60a-482b-a4fb-6fa593578292 not found, creating... [ 723.004528] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.004688] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.004847] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.005179] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.005350] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.005719] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.005929] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.006080] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.006308] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.006536] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.006720] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 10a428b2-f60a-482b-a4fb-6fa593578292 is going to be created. [ 723.030018] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.030293] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.030407] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.030714] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.030950] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.031261] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-10a428b2-f60a-482b-a4fb-6fa593578292" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.427330] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02c59c8a-da67-420a-8de3-ef613658b83d in Status: SUCCESS [ 723.427642] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02c59c8a-da67-420a-8de3-ef613658b83d deletion is rescheduled due to dependency. [ 723.427807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.457965] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.458186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.458263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.458450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.458545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.458752] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.458930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.458930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.459111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.459171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.459320] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 is going to be updated. [ 723.489474] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.489680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.489680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.489822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.489973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.499643] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 in Status: IN_PROGRESS for 2s [ 723.773191] env[66364]: INFO networking_nsxv3.common.synchronization [req-119f9fdd-2739-4385-9c2a-514637b7a003 req-7708648b-0017-4167-a1b4-4e72f71314f2 service nova] Enqueued Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_rules [ 723.773349] env[66364]: INFO networking_nsxv3.common.synchronization [req-119f9fdd-2739-4385-9c2a-514637b7a003 req-7708648b-0017-4167-a1b4-4e72f71314f2 service nova] Enqueued Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 723.773517] env[66364]: INFO networking_nsxv3.common.synchronization [req-119f9fdd-2739-4385-9c2a-514637b7a003 req-7708648b-0017-4167-a1b4-4e72f71314f2 service nova] Enqueued Resource ID: 10a428b2-f60a-482b-a4fb-6fa593578292 with Priority: HIGHEST for action port [ 723.774067] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_rules [ 723.774365] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 723.774492] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10a428b2-f60a-482b-a4fb-6fa593578292 with Priority: HIGHEST for action port [ 723.774769] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.774929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.774977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.775222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.775308] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.776961] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.776961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.777157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.777221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.777383] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.777519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.777564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.777703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.777789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.777880] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.779640] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-10a428b2-f60a-482b-a4fb-6fa593578292 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.779757] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10a428b2-f60a-482b-a4fb-6fa593578292" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.779823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10a428b2-f60a-482b-a4fb-6fa593578292" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.780085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10a428b2-f60a-482b-a4fb-6fa593578292" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.780140] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10a428b2-f60a-482b-a4fb-6fa593578292',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.823891] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 723.826749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.826749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.826749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.826749] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.826749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.826749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.826749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.826749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.826749] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.277370] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.277703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.282791] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10a428b2-f60a-482b-a4fb-6fa593578292 with status ACTIVE [ 724.282791] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.282990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.282990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.283487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.283487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.283487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.283640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.283640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.283792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.283822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.284168] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.284168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.284168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.284302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.284363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.284424] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10a428b2-f60a-482b-a4fb-6fa593578292 is going to be updated. [ 724.285563] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.319024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.319024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.319024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.319024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.319024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.319024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10a428b2-f60a-482b-a4fb-6fa593578292" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.328446] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.328623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.328623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.328877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.329015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.329234] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.329450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.329450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.329922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.329922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.329922] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be updated. [ 724.394389] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.394545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.394612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.394833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.394974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.416562] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: IN_PROGRESS for 2s [ 724.515956] env[66364]: INFO networking_nsxv3.common.synchronization [None req-8b0e4fd9-0980-4144-a8e9-5a984622e905 None None] Enqueued Resource ID: f559f9b1-9578-4e60-b681-2b24fd80a9f4 with Priority: HIGHEST for action port [ 724.516052] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f559f9b1-9578-4e60-b681-2b24fd80a9f4 with Priority: HIGHEST for action port [ 724.516343] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-f559f9b1-9578-4e60-b681-2b24fd80a9f4 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.516465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f559f9b1-9578-4e60-b681-2b24fd80a9f4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.516528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f559f9b1-9578-4e60-b681-2b24fd80a9f4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.516785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f559f9b1-9578-4e60-b681-2b24fd80a9f4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.516867] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f559f9b1-9578-4e60-b681-2b24fd80a9f4',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.788130] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.020236] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f559f9b1-9578-4e60-b681-2b24fd80a9f4 [ 725.020368] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.020446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.020506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.021541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.021541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.021541] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f559f9b1-9578-4e60-b681-2b24fd80a9f4 already deleted. [ 725.021541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f559f9b1-9578-4e60-b681-2b24fd80a9f4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.293884] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.293884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.293884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.293884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.293884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.293884] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007f96f6-a408-4a76-b5c6-eceae8238916 is going to be created. [ 725.325675] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.325675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.325675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.325912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.326026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.337774] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: UNINITIALIZED for 2s [ 725.513139] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 in Status: SUCCESS [ 725.513139] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7 deletion is rescheduled due to dependency. [ 725.513139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.716919] env[66364]: INFO networking_nsxv3.common.synchronization [None req-6138642a-d1f9-4c05-b8ee-eba7b4d3aa2f None None] Enqueued Resource ID: ad43ef1d-d772-4c25-a4bb-d1202c93a8d1 with Priority: HIGHEST for action port [ 725.717587] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad43ef1d-d772-4c25-a4bb-d1202c93a8d1 with Priority: HIGHEST for action port [ 725.721625] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad43ef1d-d772-4c25-a4bb-d1202c93a8d1 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.721625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad43ef1d-d772-4c25-a4bb-d1202c93a8d1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.721625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad43ef1d-d772-4c25-a4bb-d1202c93a8d1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.722138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad43ef1d-d772-4c25-a4bb-d1202c93a8d1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.722138] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad43ef1d-d772-4c25-a4bb-d1202c93a8d1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.225774] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad43ef1d-d772-4c25-a4bb-d1202c93a8d1 [ 726.225774] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.225774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.225774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.225774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.225774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.225774] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad43ef1d-d772-4c25-a4bb-d1202c93a8d1 already deleted. [ 726.225774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad43ef1d-d772-4c25-a4bb-d1202c93a8d1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.430464] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5467face-590a-4281-b5c2-cf02d5a2e65f in Status: SUCCESS [ 726.430725] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f deletion is rescheduled due to dependency. [ 726.430725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.352654] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: SUCCESS [ 727.352654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.352654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.352654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.352654] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.352654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.352654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.352654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.352654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.352654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.352654] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.858283] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.858786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.858786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.859437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.859437] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.859437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.859437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.859709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.859852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.860032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.860772] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.860879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.860946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.861125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.861281] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.861378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.861442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.861620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.861724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.861808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.861903] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.364783] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 007f96f6-a408-4a76-b5c6-eceae8238916: rpc.has_security_group_logging(os_id): False [ 728.390891] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.390891] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.390891] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.390891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.391536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.392106] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.392278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.392334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.392446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.392521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.392604] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 007f96f6-a408-4a76-b5c6-eceae8238916 is going to be created. [ 728.480988] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.480988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.480988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.480988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.480988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.498058] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: IN_PROGRESS for 2s [ 728.646049] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b100b91a-a11c-4fc8-89d0-f6548c740d3b None None] Enqueued Resource ID: 565d2b67-d9e6-4a87-8417-c3d993fe6653 with Priority: HIGHEST for action port [ 728.647090] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 565d2b67-d9e6-4a87-8417-c3d993fe6653 with Priority: HIGHEST for action port [ 728.647970] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-565d2b67-d9e6-4a87-8417-c3d993fe6653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.648209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-565d2b67-d9e6-4a87-8417-c3d993fe6653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.648968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-565d2b67-d9e6-4a87-8417-c3d993fe6653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.649344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-565d2b67-d9e6-4a87-8417-c3d993fe6653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.649496] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('565d2b67-d9e6-4a87-8417-c3d993fe6653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.155502] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 565d2b67-d9e6-4a87-8417-c3d993fe6653 [ 729.155789] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.155902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.155964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.156209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.156303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.156407] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:565d2b67-d9e6-4a87-8417-c3d993fe6653 already deleted. [ 729.156486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-565d2b67-d9e6-4a87-8417-c3d993fe6653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.818198] env[66364]: INFO networking_nsxv3.common.synchronization [None req-64ab9c1d-9871-41c1-a59a-ed7f42601b04 None None] Enqueued Resource ID: 1dc74117-bb2b-4b13-ad72-c17f62917d75 with Priority: HIGHEST for action port [ 729.819470] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dc74117-bb2b-4b13-ad72-c17f62917d75 with Priority: HIGHEST for action port [ 729.819860] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dc74117-bb2b-4b13-ad72-c17f62917d75 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.819987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dc74117-bb2b-4b13-ad72-c17f62917d75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.820037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dc74117-bb2b-4b13-ad72-c17f62917d75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.820425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dc74117-bb2b-4b13-ad72-c17f62917d75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.820518] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dc74117-bb2b-4b13-ad72-c17f62917d75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.981524] env[66364]: INFO networking_nsxv3.common.synchronization [req-f75653e1-57ca-4929-9066-78d6949882ce req-5ec7166f-9b45-41c8-b596-643557fe6f22 tempest-InstanceActionsNegativeTestJSON-1996456305 tempest-InstanceActionsNegativeTestJSON-1996456305-project-member] Enqueued Resource ID: cb447688-9fc5-4154-bc02-69edb9629669 with Priority: HIGHEST for action security_group_members [ 729.984041] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb447688-9fc5-4154-bc02-69edb9629669 with Priority: HIGHEST for action security_group_members [ 729.984521] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb447688-9fc5-4154-bc02-69edb9629669 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.984732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.984857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.985191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.985371] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.986145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.986294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.986587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.986755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.986985] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb447688-9fc5-4154-bc02-69edb9629669',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.324141] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1dc74117-bb2b-4b13-ad72-c17f62917d75 [ 730.324941] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.324941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.324941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.325197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.325197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.325406] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1dc74117-bb2b-4b13-ad72-c17f62917d75 already deleted. [ 730.325550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dc74117-bb2b-4b13-ad72-c17f62917d75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.467490] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-59 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.467490] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-59" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.467681] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-59" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.467909] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-59" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.468201] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.468378] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.468549] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.468882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.469083] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.469366] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.469669] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.469849] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.469984] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.470202] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.470427] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.470653] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.492335] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.492548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.492594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.492812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.492909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.494316] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.494316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.494316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.494316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.494316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.494316] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb447688-9fc5-4154-bc02-69edb9629669 already deleted. [ 730.494316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.497971] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.498198] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.498444] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.498714] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-59" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.499174] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.499426] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.499608] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.503028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.503028] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.515854] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: SUCCESS [ 730.516105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.978650] env[66364]: INFO networking_nsxv3.common.synchronization [req-e5fd4f3d-b440-4060-822c-030787fb9566 req-0fcaddf9-1705-4618-be8a-f4c8fa3e3882 tempest-ServerTagsTestJSON-1343586133 tempest-ServerTagsTestJSON-1343586133-project-member] Enqueued Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGHEST for action security_group_members [ 730.979304] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGHEST for action security_group_members [ 730.979641] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.979772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.979841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.981401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.981683] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.981834] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.981923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.982271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.982388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.982491] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a51a2156-9364-4e92-8d3f-5ecb8f11f0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.005135] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.005380] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.005511] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.005781] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.005921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.006080] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb not found, creating... [ 731.006347] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.006503] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.006644] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.006938] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.008952] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.008952] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.008952] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.008952] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.009272] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.009272] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.009329] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb is going to be created. [ 731.037200] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.037459] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.037560] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.037859] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.038193] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.038569] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.485844] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.486568] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.493228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.493228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.493228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.493228] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.493228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.493228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.493228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.493228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.493228] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 is going to be updated. [ 731.507327] env[66364]: INFO networking_nsxv3.common.synchronization [req-1b453b85-5bda-4907-92cb-10c1c64ec31f req-7a26f015-da7a-4104-a945-04191337f53a tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 731.507992] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 731.508307] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.508448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.508593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.509376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.509376] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.509376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.509376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.509722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.509722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.509722] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.526761] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.526975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.527045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.527279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.527465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.540296] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 in Status: IN_PROGRESS for 2s [ 731.781193] env[66364]: INFO networking_nsxv3.common.synchronization [req-f75653e1-57ca-4929-9066-78d6949882ce req-0cfa99df-e9d5-44d6-9a5d-72f3203e4636 service nova] Enqueued Resource ID: cb447688-9fc5-4154-bc02-69edb9629669 with Priority: HIGHEST for action security_group_rules [ 731.781193] env[66364]: INFO networking_nsxv3.common.synchronization [req-f75653e1-57ca-4929-9066-78d6949882ce req-0cfa99df-e9d5-44d6-9a5d-72f3203e4636 service nova] Enqueued Resource ID: cb447688-9fc5-4154-bc02-69edb9629669 with Priority: HIGHEST for action security_group_members [ 731.781193] env[66364]: INFO networking_nsxv3.common.synchronization [req-f75653e1-57ca-4929-9066-78d6949882ce req-0cfa99df-e9d5-44d6-9a5d-72f3203e4636 service nova] Enqueued Resource ID: ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb with Priority: HIGHEST for action port [ 731.781193] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb447688-9fc5-4154-bc02-69edb9629669 with Priority: HIGHEST for action security_group_rules [ 731.781193] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb447688-9fc5-4154-bc02-69edb9629669 with Priority: HIGHEST for action security_group_members [ 731.781193] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb with Priority: HIGHEST for action port [ 731.781729] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb447688-9fc5-4154-bc02-69edb9629669 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.781955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.782122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.782535] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.782792] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb447688-9fc5-4154-bc02-69edb9629669',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.783937] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb447688-9fc5-4154-bc02-69edb9629669 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.784204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.784372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.786019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.786019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.786019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.786019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.786019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.786019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.786019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb447688-9fc5-4154-bc02-69edb9629669',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.789045] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.789443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.789601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.790352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.790495] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.011805] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.011966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.013203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.013203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.013203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.013203] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.014194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.014194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.014194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.014194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.014194] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 732.046262] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.046262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.046262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.046262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.046262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.054945] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 732.282304] env[66364]: INFO networking_nsxv3.common.synchronization [None req-72ad59cb-e533-4e45-aec6-2873fe057ef3 None None] Enqueued Resource ID: a35473f6-b0ac-4de3-b422-4b37e89adab1 with Priority: HIGHEST for action port [ 732.282396] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a35473f6-b0ac-4de3-b422-4b37e89adab1 with Priority: HIGHEST for action port [ 732.282820] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-a35473f6-b0ac-4de3-b422-4b37e89adab1 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.283105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a35473f6-b0ac-4de3-b422-4b37e89adab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.283324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a35473f6-b0ac-4de3-b422-4b37e89adab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.283723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a35473f6-b0ac-4de3-b422-4b37e89adab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.283965] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a35473f6-b0ac-4de3-b422-4b37e89adab1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.292638] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb447688-9fc5-4154-bc02-69edb9629669 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.292779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.293376] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb447688-9fc5-4154-bc02-69edb9629669',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.294036] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb with status ACTIVE [ 732.294325] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.294697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.294697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.295456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.295456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.295456] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.295888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.295888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.295888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.295969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.296261] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.296339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.296430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.296594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.296673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.296756] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb is going to be updated. [ 732.334252] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.334475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.334591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.334842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.335026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.335209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef4ffd50-95ba-4b61-bcc0-fb6d0c5962bb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.787282] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a35473f6-b0ac-4de3-b422-4b37e89adab1 [ 732.787282] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.787282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.787282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.787756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.787756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.787756] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a35473f6-b0ac-4de3-b422-4b37e89adab1 already deleted. [ 732.787756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a35473f6-b0ac-4de3-b422-4b37e89adab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.799294] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb447688-9fc5-4154-bc02-69edb9629669',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.067738] env[66364]: INFO networking_nsxv3.common.synchronization [req-fa4c01cf-6f89-4b84-8c82-2563c2b47494 req-6ee60c27-d5e5-4ce0-a724-cc2d09f91432 tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 733.068316] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 733.068633] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.068754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.068817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.069036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.069321] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.069321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.069475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.069520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.069613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.069658] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.301833] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.301998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.302079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.302986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.302986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.302986] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb447688-9fc5-4154-bc02-69edb9629669 is going to be created. [ 733.340314] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.340314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.340432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.340649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.340832] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.358208] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb447688-9fc5-4154-bc02-69edb9629669 in Status: UNINITIALIZED for 2s [ 733.458566] env[66364]: INFO networking_nsxv3.common.synchronization [req-fa4c01cf-6f89-4b84-8c82-2563c2b47494 req-dc842e1c-7de4-4669-b887-bb96ccfd4df8 tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 733.458566] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 733.458566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.458566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.554359] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 in Status: SUCCESS [ 733.554530] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 deletion is rescheduled due to dependency. [ 733.554724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.572476] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.572823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.572928] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.573286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.573286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.573966] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.573966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.573966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.573966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.573966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.574344] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 733.601971] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.602127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.602232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.602472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.602612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.612665] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 733.784170] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-126 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.784170] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-126" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.784170] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-126" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.784170] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-126" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.786036] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.786036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.786036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.786036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.786036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.786036] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.786036] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.786036] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.786036] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.786036] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.786036] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.786036] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.806155] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.806443] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.806524] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.807145] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-126" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.807145] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.807327] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.807404] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.807799] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.807838] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.064393] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 734.064564] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 deletion is rescheduled due to dependency. [ 734.064676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.311362] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.311671] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.311808] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.312441] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.312441] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.312580] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76 not found, creating... [ 734.312810] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.312992] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.313120] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.313438] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.313594] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.313926] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.314138] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.314250] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.314719] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.314719] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.314834] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76 is going to be created. [ 734.341157] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.341439] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.341586] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.341867] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.342151] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.342466] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.183619] env[66364]: INFO networking_nsxv3.common.synchronization [req-fa4c01cf-6f89-4b84-8c82-2563c2b47494 req-fddc283c-ef9f-47e0-91de-5555ee34a616 service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 735.184573] env[66364]: INFO networking_nsxv3.common.synchronization [req-fa4c01cf-6f89-4b84-8c82-2563c2b47494 req-fddc283c-ef9f-47e0-91de-5555ee34a616 service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 735.184573] env[66364]: INFO networking_nsxv3.common.synchronization [req-fa4c01cf-6f89-4b84-8c82-2563c2b47494 req-fddc283c-ef9f-47e0-91de-5555ee34a616 service nova] Enqueued Resource ID: e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76 with Priority: HIGHEST for action port [ 735.187746] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 735.188092] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 735.188260] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76 with Priority: HIGHEST for action port [ 735.189769] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.189981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.190325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.190417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.190520] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.195355] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.195523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.195842] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.196029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.196130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.196444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.196599] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.368861] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb447688-9fc5-4154-bc02-69edb9629669 in Status: SUCCESS [ 735.369120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.369304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.369563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.369832] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.369926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.369978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.370249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.370370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.370525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.370578] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb447688-9fc5-4154-bc02-69edb9629669',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.627808] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 735.627808] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b deletion is rescheduled due to dependency. [ 735.627808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.628022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.628259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.628449] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.628566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.628627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.628794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.628875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.628968] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.699225] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76 with status ACTIVE [ 735.699543] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.699776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.699898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.700215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.700358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.700673] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.700816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.700908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.701172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.701292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.701524] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.701631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.701693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.701850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.701929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.702059] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76 is going to be updated. [ 735.704621] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.704621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.726677] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.726935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.726935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.727084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.727393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.727393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3bd3c0c-c08d-4290-87e7-0e80a0bc1e76" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.873442] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb447688-9fc5-4154-bc02-69edb9629669 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.873685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.873804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.874158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.874431] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.874607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.874725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.874995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.875166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.875312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.875566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb447688-9fc5-4154-bc02-69edb9629669 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.875728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.875842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.876097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.876338] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.876502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.876619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.876847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.876987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.877152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.877314] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb447688-9fc5-4154-bc02-69edb9629669',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.950118] env[66364]: INFO networking_nsxv3.common.synchronization [req-479db675-ab87-4112-8ae3-33ca90141cb0 req-0233f6fa-a4e6-43a0-a7e0-2219afc1c890 tempest-ServersAdminTestJSON-1239172367 tempest-ServersAdminTestJSON-1239172367-project-member] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 735.950118] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 735.950248] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.950366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.950403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.951134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.951134] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.951134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.951134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.951386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.951386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.951386] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.131794] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.190059] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.190343] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-366" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.190406] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-366" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.190969] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-366" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.191305] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.191550] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.191687] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.192281] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.192495] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.192750] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.192905] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.193091] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.193270] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.194293] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.194293] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.194293] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.214656] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.214656] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.214656] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.214656] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-366" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.214964] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-755dff8f-1de1-44f6-a0d5-2ea62233e784 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.215351] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-755dff8f-1de1-44f6-a0d5-2ea62233e784" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.215351] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-755dff8f-1de1-44f6-a0d5-2ea62233e784" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.215914] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-755dff8f-1de1-44f6-a0d5-2ea62233e784" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.216156] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('755dff8f-1de1-44f6-a0d5-2ea62233e784',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.379416] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb447688-9fc5-4154-bc02-69edb9629669: rpc.has_security_group_logging(os_id): False [ 736.398901] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.399065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.399159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.399390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.399484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.399755] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.399847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.399928] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.400090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.400144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.400366] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.400464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.400521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.400663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.400736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.400983] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.401067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.401172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.401345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.401434] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.401531] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb447688-9fc5-4154-bc02-69edb9629669 is going to be created. [ 736.454938] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.462907] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.462907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.462907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.464427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.464427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.480013] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb447688-9fc5-4154-bc02-69edb9629669 in Status: IN_PROGRESS for 2s [ 736.635323] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.718703] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.718905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.719039] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.719340] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.719487] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.719765] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 755dff8f-1de1-44f6-a0d5-2ea62233e784 not found, creating... [ 736.719872] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.720036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.720174] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.720401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.720534] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.720809] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.720956] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.721103] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.721309] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.721443] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.721575] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 755dff8f-1de1-44f6-a0d5-2ea62233e784 is going to be created. [ 736.746023] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.746023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.746023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.746023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.746023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.746023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-755dff8f-1de1-44f6-a0d5-2ea62233e784" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.957350] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.137953] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.138112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.138189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.138423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.138572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.138866] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 737.174047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.174207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.174251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.174479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.174671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.190295] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 737.205160] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-585 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.205418] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.205537] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.205811] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.206095] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.206264] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.206471] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.206557] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.206699] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.206905] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.207012] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.207118] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.207219] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.207323] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.207421] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.207544] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.234742] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.234742] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.234849] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.235040] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-585" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.235423] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-8ae53f96-dfcf-4d43-9962-92bac2351eda taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.235603] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-8ae53f96-dfcf-4d43-9962-92bac2351eda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.235835] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-8ae53f96-dfcf-4d43-9962-92bac2351eda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.236437] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-8ae53f96-dfcf-4d43-9962-92bac2351eda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.236673] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ae53f96-dfcf-4d43-9962-92bac2351eda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.460029] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.460263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.460337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.460558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.460648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.460746] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 737.497977] env[66364]: INFO networking_nsxv3.common.synchronization [req-fa4c01cf-6f89-4b84-8c82-2563c2b47494 req-026e675c-6696-42b9-bba9-51ba06faf54e service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 737.498179] env[66364]: INFO networking_nsxv3.common.synchronization [req-fa4c01cf-6f89-4b84-8c82-2563c2b47494 req-026e675c-6696-42b9-bba9-51ba06faf54e service nova] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 737.498312] env[66364]: INFO networking_nsxv3.common.synchronization [req-fa4c01cf-6f89-4b84-8c82-2563c2b47494 req-026e675c-6696-42b9-bba9-51ba06faf54e service nova] Enqueued Resource ID: 755dff8f-1de1-44f6-a0d5-2ea62233e784 with Priority: HIGHEST for action port [ 737.498865] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_rules [ 737.499029] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 737.499145] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 755dff8f-1de1-44f6-a0d5-2ea62233e784 with Priority: HIGHEST for action port [ 737.499671] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.499671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.499840] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.499840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.499933] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-755dff8f-1de1-44f6-a0d5-2ea62233e784 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.500022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-755dff8f-1de1-44f6-a0d5-2ea62233e784" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.500089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-755dff8f-1de1-44f6-a0d5-2ea62233e784" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.500320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-755dff8f-1de1-44f6-a0d5-2ea62233e784" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.500409] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('755dff8f-1de1-44f6-a0d5-2ea62233e784',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.512261] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.512420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.512420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.512701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.512844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.527707] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 737.742023] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.742023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.742023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.742023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.742023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.742023] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 8ae53f96-dfcf-4d43-9962-92bac2351eda not found, creating... [ 737.742023] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.742023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.742023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.742023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.742023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.743106] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.743106] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.743106] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.743106] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.743106] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.743106] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 8ae53f96-dfcf-4d43-9962-92bac2351eda is going to be created. [ 737.765041] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.765041] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.765041] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.765041] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.765041] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.765041] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-8ae53f96-dfcf-4d43-9962-92bac2351eda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.003020] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 755dff8f-1de1-44f6-a0d5-2ea62233e784 with status ACTIVE [ 738.003138] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.003309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.003412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.003629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.003737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.003852] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.003944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.003995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.004176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.004255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.004432] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.004590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.004590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.004845] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.004845] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.004935] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 755dff8f-1de1-44f6-a0d5-2ea62233e784 is going to be updated. [ 738.028835] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.029036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.029079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.029289] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.029430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.029589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-755dff8f-1de1-44f6-a0d5-2ea62233e784" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.495279] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb447688-9fc5-4154-bc02-69edb9629669 in Status: SUCCESS [ 738.495584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.590348] env[66364]: INFO networking_nsxv3.common.synchronization [req-479db675-ab87-4112-8ae3-33ca90141cb0 req-01ac7709-eace-47e2-abd6-8a29a045d549 service nova] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_rules [ 738.590803] env[66364]: INFO networking_nsxv3.common.synchronization [req-479db675-ab87-4112-8ae3-33ca90141cb0 req-01ac7709-eace-47e2-abd6-8a29a045d549 service nova] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 738.591082] env[66364]: INFO networking_nsxv3.common.synchronization [req-479db675-ab87-4112-8ae3-33ca90141cb0 req-01ac7709-eace-47e2-abd6-8a29a045d549 service nova] Enqueued Resource ID: 8ae53f96-dfcf-4d43-9962-92bac2351eda with Priority: HIGHEST for action port [ 738.592158] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_rules [ 738.592158] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 738.592358] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae53f96-dfcf-4d43-9962-92bac2351eda with Priority: HIGHEST for action port [ 738.592781] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.593062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.595783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.595783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.595783] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.595783] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.595783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.595783] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ae53f96-dfcf-4d43-9962-92bac2351eda taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.595783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ae53f96-dfcf-4d43-9962-92bac2351eda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.595783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ae53f96-dfcf-4d43-9962-92bac2351eda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.595783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ae53f96-dfcf-4d43-9962-92bac2351eda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.596553] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ae53f96-dfcf-4d43-9962-92bac2351eda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.853994] env[66364]: INFO networking_nsxv3.common.synchronization [req-cd2a4c9d-7f36-49ec-9c24-321e67a8d383 req-3c3514b0-4eb2-48dc-9942-9adca7b9a4b1 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 738.853994] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 738.853994] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.853994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.853994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.853994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.855839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.855839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.855839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.855839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.855839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.856081] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.097982] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.098169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.103094] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ae53f96-dfcf-4d43-9962-92bac2351eda with status ACTIVE [ 739.103288] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.103462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.103534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.103773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.103868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.104559] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.104559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.104559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.104559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.104559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.104867] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.104867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.104867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.105054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.105054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.105054] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ae53f96-dfcf-4d43-9962-92bac2351eda is going to be updated. [ 739.128350] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.128596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.128687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.128896] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.129044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.129198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ae53f96-dfcf-4d43-9962-92bac2351eda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.205451] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 739.205451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.205451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.205674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.206677] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.206677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.206677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.206677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.206677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.206677] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.304696] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-850 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.305161] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-850" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.305534] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-850" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.305793] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-850" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.306239] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.306497] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.306724] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.307130] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.307383] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.307717] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.307924] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.308143] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.308355] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.308645] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.308903] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.309196] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.333975] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.335387] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.337187] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.337187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-850" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.337187] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-c6ff7002-5a0b-452d-891f-f4c697b8aad8 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.337187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.337187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.337187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.337187] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ff7002-5a0b-452d-891f-f4c697b8aad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.358548] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.539457] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 739.539752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.539885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.540119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.540323] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.540445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.540510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.540671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.540754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.540847] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.708819] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.842409] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.842409] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.842409] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.842409] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.842409] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.842409] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port c6ff7002-5a0b-452d-891f-f4c697b8aad8 not found, creating... [ 739.842409] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.842409] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.842409] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.842918] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.842953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.843444] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.843625] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.843731] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.844000] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.844160] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.844317] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 is going to be created. [ 739.861987] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.874144] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.874284] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.874442] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.875058] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.875155] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.875454] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.046165] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.211639] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.363951] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.364129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.364196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.364418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.364542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.364666] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 740.393770] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.394136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.394136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.394213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.394353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.404497] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 740.549931] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.645724] env[66364]: INFO networking_nsxv3.common.synchronization [req-cd2a4c9d-7f36-49ec-9c24-321e67a8d383 req-d0045b82-5f1f-406a-a5ce-8d1cb9297a68 service nova] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 740.645839] env[66364]: INFO networking_nsxv3.common.synchronization [req-cd2a4c9d-7f36-49ec-9c24-321e67a8d383 req-d0045b82-5f1f-406a-a5ce-8d1cb9297a68 service nova] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 740.645968] env[66364]: INFO networking_nsxv3.common.synchronization [req-cd2a4c9d-7f36-49ec-9c24-321e67a8d383 req-d0045b82-5f1f-406a-a5ce-8d1cb9297a68 service nova] Enqueued Resource ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 with Priority: HIGHEST for action port [ 740.646534] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 740.646782] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 740.646860] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 with Priority: HIGHEST for action port [ 740.647926] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.648085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.648153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.648353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.648437] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.649528] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.649626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.649816] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6ff7002-5a0b-452d-891f-f4c697b8aad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.649915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.649976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.650269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.650330] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ff7002-5a0b-452d-891f-f4c697b8aad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.713937] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.714094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.714159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.714388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.714498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.714593] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 740.747559] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.747824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.747824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.747973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.748128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.759328] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 741.053363] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.053363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.053363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.053363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.053363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.053363] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 741.082857] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.083175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.083175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.083314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.083522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.095036] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 741.152531] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.152531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.152683] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6ff7002-5a0b-452d-891f-f4c697b8aad8 with status ACTIVE [ 741.152861] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.153009] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.153064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.153270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.153378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.153576] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.153677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.153747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.154025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.154025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.154170] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.154271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.154334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.154523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.154603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.154690] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 is going to be updated. [ 741.187700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.188597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.188597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.188597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.188597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.188597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.710394] env[66364]: INFO networking_nsxv3.common.synchronization [req-001398e7-b94c-434c-aaaa-43b47d706a4a req-3069d26f-40ab-4423-9904-96480de784a9 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_members [ 741.711058] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_members [ 741.711417] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.711556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.711618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.712026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.712384] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.712384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.712518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.712614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.712697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.712790] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.214865] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.215073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.215134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.215326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.215413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.216107] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.216107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.216203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.217030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.217030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.217030] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 already deleted. [ 742.217030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.219923] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.219923] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.219923] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.219923] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.219923] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.220316] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.220316] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.220611] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.220744] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.220935] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.221050] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.221149] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.221247] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.222014] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.222014] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.222014] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.243820] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.243938] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.244083] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.244249] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.244590] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-4f522c0a-4861-42ae-a2bb-09db23cba859 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.244762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-4f522c0a-4861-42ae-a2bb-09db23cba859" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.244873] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-4f522c0a-4861-42ae-a2bb-09db23cba859" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.245215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-4f522c0a-4861-42ae-a2bb-09db23cba859" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.245350] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f522c0a-4861-42ae-a2bb-09db23cba859',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.415074] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 742.415309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.415467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.415683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.416072] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.416072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.416072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.416254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.416309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.416539] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.523034] env[66364]: INFO networking_nsxv3.common.synchronization [None req-5cdfb0a6-cce2-4367-828e-d6bee89e942c None None] Enqueued Resource ID: 5503d6cb-c1fe-47cc-9eec-b5034cf2dba2 with Priority: HIGHEST for action port [ 742.523629] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5503d6cb-c1fe-47cc-9eec-b5034cf2dba2 with Priority: HIGHEST for action port [ 742.523946] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5503d6cb-c1fe-47cc-9eec-b5034cf2dba2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.524102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5503d6cb-c1fe-47cc-9eec-b5034cf2dba2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.524171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5503d6cb-c1fe-47cc-9eec-b5034cf2dba2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.524496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5503d6cb-c1fe-47cc-9eec-b5034cf2dba2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.524610] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5503d6cb-c1fe-47cc-9eec-b5034cf2dba2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.750093] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.750093] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.750093] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.750093] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.750093] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.750093] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 4f522c0a-4861-42ae-a2bb-09db23cba859 not found, creating... [ 742.750093] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.750093] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.750093] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.750093] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.750093] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.750711] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.750711] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.750711] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.751058] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.751328] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.751558] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 4f522c0a-4861-42ae-a2bb-09db23cba859 is going to be created. [ 742.771855] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 742.772102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.772327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.772567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.772758] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.772871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.772936] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.773099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.773179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.773261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.773378] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.775093] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.775263] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.775376] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.775584] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.775789] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.775978] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-4f522c0a-4861-42ae-a2bb-09db23cba859" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.776636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.776794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.776941] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.777117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.777191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.777335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.777415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.777504] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.920136] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.028207] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5503d6cb-c1fe-47cc-9eec-b5034cf2dba2 [ 743.028458] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.028619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.029178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.029178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.029178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.029178] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5503d6cb-c1fe-47cc-9eec-b5034cf2dba2 already deleted. [ 743.029389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5503d6cb-c1fe-47cc-9eec-b5034cf2dba2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.106889] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 743.107132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.107345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.107557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.107805] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.107885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.107923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.108098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.108183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.108346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.108407] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.279164] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.281133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.281846] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.425369] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.614165] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.614165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.614165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.614165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.614165] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.614165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.614165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.614165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.614165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.614165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.614487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.614487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.614487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.614628] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.615965] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.615965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.615965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.615965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.615965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.615965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.615965] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.622059] env[66364]: INFO networking_nsxv3.common.synchronization [req-001398e7-b94c-434c-aaaa-43b47d706a4a req-12720b5e-8c73-4033-9df9-f25bcda55124 service nova] Enqueued Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_rules [ 743.624128] env[66364]: INFO networking_nsxv3.common.synchronization [req-001398e7-b94c-434c-aaaa-43b47d706a4a req-12720b5e-8c73-4033-9df9-f25bcda55124 service nova] Enqueued Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_members [ 743.624128] env[66364]: INFO networking_nsxv3.common.synchronization [req-001398e7-b94c-434c-aaaa-43b47d706a4a req-12720b5e-8c73-4033-9df9-f25bcda55124 service nova] Enqueued Resource ID: 4f522c0a-4861-42ae-a2bb-09db23cba859 with Priority: HIGHEST for action port [ 743.624128] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_rules [ 743.624128] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_members [ 743.624128] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f522c0a-4861-42ae-a2bb-09db23cba859 with Priority: HIGHEST for action port [ 743.624128] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.624128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.624689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.624890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.624979] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.625987] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.626148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.626222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.626430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.626614] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.626712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.626770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.626991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.627050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.627130] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.628487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f522c0a-4861-42ae-a2bb-09db23cba859 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.628617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f522c0a-4861-42ae-a2bb-09db23cba859" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.628677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f522c0a-4861-42ae-a2bb-09db23cba859" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.628869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f522c0a-4861-42ae-a2bb-09db23cba859" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.628948] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f522c0a-4861-42ae-a2bb-09db23cba859',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.788683] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.928032] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.928232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.928273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.929099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.929099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.929099] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 743.970767] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.970927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.970989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.971270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.971466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.986186] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 744.124397] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebb41e34-3a6d-4c7e-a19c-48afdcc86d62: rpc.has_security_group_logging(os_id): False [ 744.138516] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.138516] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.138516] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.138893] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f522c0a-4861-42ae-a2bb-09db23cba859 with status ACTIVE [ 744.139740] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.139740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.139740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.139740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.139740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.142095] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.142095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.142095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.142095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.142095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.142250] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.142335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.142490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.143100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.143100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.143100] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f522c0a-4861-42ae-a2bb-09db23cba859 is going to be updated. [ 744.148033] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.148182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.148217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.148852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.148852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.148852] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.148852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.149135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.149135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.149213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.149617] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.149617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.149617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.149896] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.149896] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.150040] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.150958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.150958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.150958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.150958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.150958] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 744.179394] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.180466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.180466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.180466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.180466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.180466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f522c0a-4861-42ae-a2bb-09db23cba859" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.252186] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.252381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.252441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.252629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.252791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.288549] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 744.291718] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.292012] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.292183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.292579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.292761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.292954] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 744.356817] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.356994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.357258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.357316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.357474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.371523] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 744.375707] env[66364]: INFO networking_nsxv3.common.synchronization [req-a79abc5a-563a-4a17-a765-1aca40f5424a req-0e28b65f-904f-4dc2-9103-007f04db557e tempest-AttachVolumeShelveTestJSON-446961995 tempest-AttachVolumeShelveTestJSON-446961995-project-member] Enqueued Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_members [ 744.376793] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_members [ 744.377628] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.377788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.377857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.378472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.378472] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.378472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.378472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.378754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.378754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.378819] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.657108] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.808087] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.808918] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.809190] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.809529] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.809832] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.809994] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.810132] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.810357] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.810495] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.810696] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.810804] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.810906] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.811344] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.811464] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.811587] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.811694] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.831028] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.831264] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.831418] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.831604] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.831906] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-e432e73a-cdaf-4da4-b34b-f90661dd8549 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.832087] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.832202] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.832556] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.832689] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e432e73a-cdaf-4da4-b34b-f90661dd8549',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.882760] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.882907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.882945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.883162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.883293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.883474] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.883563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.883687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.883896] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.883896] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.883978] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0345151-3287-4add-b6b3-bbb72460c6bd already deleted. [ 744.884067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.129375] env[66364]: INFO networking_nsxv3.common.synchronization [None req-33398ee8-a25b-4b85-8072-56305dccc6d9 None None] Enqueued Resource ID: 6bbe15af-a260-49df-b5ef-b99d6d1543ad with Priority: HIGHEST for action port [ 745.131104] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bbe15af-a260-49df-b5ef-b99d6d1543ad with Priority: HIGHEST for action port [ 745.131863] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bbe15af-a260-49df-b5ef-b99d6d1543ad taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.132368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bbe15af-a260-49df-b5ef-b99d6d1543ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.132368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bbe15af-a260-49df-b5ef-b99d6d1543ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.132551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bbe15af-a260-49df-b5ef-b99d6d1543ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.133210] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bbe15af-a260-49df-b5ef-b99d6d1543ad',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.161411] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.161411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.161411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.161411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.161411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.161411] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 is going to be created. [ 745.192700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.193032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.193032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.193169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.193471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.208995] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 in Status: UNINITIALIZED for 2s [ 745.335670] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.336043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.336122] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.336496] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.336921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.336921] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port e432e73a-cdaf-4da4-b34b-f90661dd8549 not found, creating... [ 745.337198] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.337497] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.337553] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.337911] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.338023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.339169] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.339362] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.339507] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.339773] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.340108] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.340266] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: e432e73a-cdaf-4da4-b34b-f90661dd8549 is going to be created. [ 745.380725] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.380725] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.380925] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.381526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.381526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.382628] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.640657] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bbe15af-a260-49df-b5ef-b99d6d1543ad [ 745.640883] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.641041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.641041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.641231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.641332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.641564] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bbe15af-a260-49df-b5ef-b99d6d1543ad already deleted. [ 745.641564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bbe15af-a260-49df-b5ef-b99d6d1543ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.000645] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 746.000998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.001125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.001348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.001546] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.001666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.001734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.001881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.001963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.002059] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.002153] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.122971] env[66364]: INFO networking_nsxv3.common.synchronization [req-a79abc5a-563a-4a17-a765-1aca40f5424a req-d2904485-386c-4d34-a890-b86c6ffc0f71 service nova] Enqueued Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_rules [ 746.123426] env[66364]: INFO networking_nsxv3.common.synchronization [req-a79abc5a-563a-4a17-a765-1aca40f5424a req-d2904485-386c-4d34-a890-b86c6ffc0f71 service nova] Enqueued Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_members [ 746.123426] env[66364]: INFO networking_nsxv3.common.synchronization [req-a79abc5a-563a-4a17-a765-1aca40f5424a req-d2904485-386c-4d34-a890-b86c6ffc0f71 service nova] Enqueued Resource ID: e432e73a-cdaf-4da4-b34b-f90661dd8549 with Priority: HIGHEST for action port [ 746.124195] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_rules [ 746.124399] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_members [ 746.124995] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e432e73a-cdaf-4da4-b34b-f90661dd8549 with Priority: HIGHEST for action port [ 746.125293] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.125421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.125487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.125771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.125813] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.126736] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.126852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.126922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.127122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.127279] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.127375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.127437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.127616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.127683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.127820] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.129253] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e432e73a-cdaf-4da4-b34b-f90661dd8549 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.129392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.129454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.129622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.129704] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e432e73a-cdaf-4da4-b34b-f90661dd8549',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.310024] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 746.310024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.390851] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 746.391911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.395564] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.395564] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.395564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.397226] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.399665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.399665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.399665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.399665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.399665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.399665] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.506821] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.506821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.506821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.507809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.507809] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.507809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.507809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.507809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.508076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.508076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.508182] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.508182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.508257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.508414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.509370] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.509370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.509370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.509370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.509370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.509370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.509370] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.632076] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.632246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.632475] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.633382] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e432e73a-cdaf-4da4-b34b-f90661dd8549 with status ACTIVE [ 746.633572] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.633768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.633768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.633951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.634052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.634226] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.634318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.634379] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.634536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.634613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.634808] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.634903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.634964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.635280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.635415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.635886] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e432e73a-cdaf-4da4-b34b-f90661dd8549 is going to be updated. [ 746.663420] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.663622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.663697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.663918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.665235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.665454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.904572] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64957bc0-2496-43d3-8cbd-8653bab5f68b: rpc.has_security_group_logging(os_id): False [ 746.923039] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.923039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.923039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.923039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.923261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.924175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.924175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.924175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.924175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.924175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.924175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.924175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.924504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.924504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.924504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.924892] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.924892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.924892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.924892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.925099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.925184] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 746.990609] env[66364]: INFO networking_nsxv3.common.synchronization [req-f1bf0f27-5086-4f14-b3bd-285037b12b02 req-033b7c1f-a27f-458c-bcc9-0eed7d4682e5 tempest-SecurityGroupRulesTestJSON-1991974859 tempest-SecurityGroupRulesTestJSON-1991974859-project-member] Enqueued Resource ID: f473d35c-3850-4878-94b0-3eca7947e9bf with Priority: HIGHEST for action security_group_rules [ 746.990609] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f473d35c-3850-4878-94b0-3eca7947e9bf with Priority: HIGHEST for action security_group_rules [ 746.991353] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f473d35c-3850-4878-94b0-3eca7947e9bf taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.991353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f473d35c-3850-4878-94b0-3eca7947e9bf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.991353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f473d35c-3850-4878-94b0-3eca7947e9bf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.991353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f473d35c-3850-4878-94b0-3eca7947e9bf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.991353] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f473d35c-3850-4878-94b0-3eca7947e9bf',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.005349] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.005349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.005349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.005349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.005349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.017343] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0ef17dd-12b4-4751-91bb-321b509b882e: rpc.has_security_group_logging(os_id): False [ 747.033729] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 747.046753] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.046939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.047015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.047305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.047354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.047720] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.047856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.048279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.048279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.048354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.049314] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.049314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.049314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.049314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.049314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.049787] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.049787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.049787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.051731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.051731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.051731] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 747.139595] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.153702] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.153702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.153950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.153950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.154567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.172402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 747.221207] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 in Status: SUCCESS [ 747.221453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.222073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.222073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.223997] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.224138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.224216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.224455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.224455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.224638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.224638] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.515033] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.515187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.515262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.515492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.515602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.515701] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f473d35c-3850-4878-94b0-3eca7947e9bf already deleted. [ 747.515789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f473d35c-3850-4878-94b0-3eca7947e9bf" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.562863] env[66364]: INFO networking_nsxv3.common.synchronization [req-9a198a0d-307d-45da-a58d-8ee44b73133a req-5196a9de-6d15-41a9-b584-1f9e7ba768a1 tempest-FloatingIPsAssociationTestJSON-640590749 tempest-FloatingIPsAssociationTestJSON-640590749-project-member] Enqueued Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 747.563414] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGHEST for action security_group_members [ 747.563709] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.563866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.563934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.566269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.566446] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.566924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.566999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.567198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.567290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.567389] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.642097] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.642639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.642639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.642639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.642822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.642822] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0345151-3287-4add-b6b3-bbb72460c6bd is going to be created. [ 747.668037] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.668496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.668496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.668496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.668729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.681645] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: UNINITIALIZED for 2s [ 747.728031] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.070498] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.070498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.070498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.071085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.071085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.071085] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.071227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.071362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.071532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.071710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.071789] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 is going to be updated. [ 748.107542] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.107762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.107762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.107991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.108152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.123472] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: IN_PROGRESS for 2s [ 748.231924] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97a7651b-f7fd-4861-bb60-9879cd8461c2: rpc.has_security_group_logging(os_id): False [ 748.265476] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.265623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.265710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.265909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.265992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.266265] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.266383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.266425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.266586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.266660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.266743] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 is going to be created. [ 748.417902] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.417902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.417902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.417902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.418311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.446355] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 in Status: IN_PROGRESS for 2s [ 749.051018] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 749.051018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.051193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.051437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.052301] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.191528] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 749.191966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.555616] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.557100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.557100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.557100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.557100] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.557100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.557100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.557100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.557100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.557100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.557100] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.695029] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: SUCCESS [ 749.695029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.695029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.695029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.695029] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.695029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.695029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.695029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.695029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.695029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.695029] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.062582] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.062582] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.062582] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.062582] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.062582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.063267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.063267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.063267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.063267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.063267] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.134229] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 in Status: SUCCESS [ 750.134459] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 deletion is rescheduled due to dependency. [ 750.134607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.200873] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.463554] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 in Status: SUCCESS [ 750.463554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.536059] env[66364]: INFO networking_nsxv3.common.synchronization [req-8e1447b3-b52e-4839-b56b-b852038f9129 req-6b625ad6-cb3b-4041-94e6-94645bc8d79a tempest-InstanceActionsNegativeTestJSON-1996456305 tempest-InstanceActionsNegativeTestJSON-1996456305-project-member] Enqueued Resource ID: cb447688-9fc5-4154-bc02-69edb9629669 with Priority: HIGHEST for action security_group_members [ 750.536650] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb447688-9fc5-4154-bc02-69edb9629669 with Priority: HIGHEST for action security_group_members [ 750.536827] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb447688-9fc5-4154-bc02-69edb9629669 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.536827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.536935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.537152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.537347] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.537475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.537559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.537758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.537863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.537986] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb447688-9fc5-4154-bc02-69edb9629669',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.567864] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64957bc0-2496-43d3-8cbd-8653bab5f68b: rpc.has_security_group_logging(os_id): False [ 750.575920] env[66364]: INFO networking_nsxv3.common.synchronization [req-58ded309-ffe5-44f3-8d72-80ea0a04312b req-4c54ff04-bc83-49bd-bad6-9130da459d22 tempest-SecurityGroupRulesTestJSON-1991974859 tempest-SecurityGroupRulesTestJSON-1991974859-project-member] Enqueued Resource ID: f80cba9a-e756-4d15-b738-7c9916735526 with Priority: HIGHEST for action security_group_rules [ 750.576817] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f80cba9a-e756-4d15-b738-7c9916735526 with Priority: HIGHEST for action security_group_rules [ 750.576817] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f80cba9a-e756-4d15-b738-7c9916735526 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.576974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f80cba9a-e756-4d15-b738-7c9916735526" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.576974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f80cba9a-e756-4d15-b738-7c9916735526" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.577839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f80cba9a-e756-4d15-b738-7c9916735526" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.577839] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f80cba9a-e756-4d15-b738-7c9916735526',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.588819] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.588977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.589062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.589373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.589431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.590038] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.590038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.590038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.590038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.590263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.590378] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.590513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.590565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.590723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.591505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.591505] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.591505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.591505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.591505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.591505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.591505] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 750.659111] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.659310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.659405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.659685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.659899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.677860] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 750.705492] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0345151-3287-4add-b6b3-bbb72460c6bd: rpc.has_security_group_logging(os_id): False [ 750.728396] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.728648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.728930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.729158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.729294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.729635] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.729809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.729911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.730214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.730391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.730533] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0345151-3287-4add-b6b3-bbb72460c6bd is going to be created. [ 750.818309] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.818309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.818309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.818309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.818309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.855522] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: IN_PROGRESS for 2s [ 751.040555] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.040754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.040851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.042477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.042477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.042477] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.042477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.042477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.042680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.042712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.042808] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb447688-9fc5-4154-bc02-69edb9629669 is going to be updated. [ 751.081221] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.081470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.081581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.081756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.082170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.096458] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb447688-9fc5-4154-bc02-69edb9629669 in Status: IN_PROGRESS for 2s [ 751.111640] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.111819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.111908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.112201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.112470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.112600] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f80cba9a-e756-4d15-b738-7c9916735526 already deleted. [ 751.112720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f80cba9a-e756-4d15-b738-7c9916735526" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.249430] env[66364]: INFO networking_nsxv3.common.synchronization [req-5595c56b-1f8a-4a40-b147-8ae04ab0eb56 req-79bbef36-e03f-4dda-9fcb-1df525b10d0b tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 752.249982] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 752.250356] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.250491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.250550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.250750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.250905] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.250997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.251441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.251612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.251702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.251795] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.699768] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 752.700068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.755932] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.756344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.756422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.756659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.756773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.757057] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.757162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.757162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.757326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.757381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.757466] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c000df34-07b2-4015-b824-73615ee8d750 is going to be updated. [ 752.786939] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.787544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.787544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.787918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.788123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.800468] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: IN_PROGRESS for 2s [ 752.869184] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: SUCCESS [ 752.869406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.112259] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb447688-9fc5-4154-bc02-69edb9629669 in Status: SUCCESS [ 753.112259] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb447688-9fc5-4154-bc02-69edb9629669 deletion is rescheduled due to dependency. [ 753.112259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb447688-9fc5-4154-bc02-69edb9629669" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.185028] env[66364]: INFO networking_nsxv3.common.synchronization [req-9e216b60-1136-4bf8-a796-216ecf5aae9d req-667a658b-282e-4e76-a335-e65cd4c53bf2 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 753.185028] env[66364]: INFO networking_nsxv3.common.synchronization [req-9e216b60-1136-4bf8-a796-216ecf5aae9d req-667a658b-282e-4e76-a335-e65cd4c53bf2 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 753.186489] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 753.186489] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 753.189597] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.189597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.189597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.189597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.189597] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.189597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.189597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.189597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.189597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.189597] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.190601] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.190730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.190800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.191099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.191256] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.191359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.191433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.191583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.191703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.191820] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.241239] env[66364]: INFO networking_nsxv3.common.synchronization [req-9e216b60-1136-4bf8-a796-216ecf5aae9d req-667a658b-282e-4e76-a335-e65cd4c53bf2 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_rules [ 753.241239] env[66364]: INFO networking_nsxv3.common.synchronization [req-9e216b60-1136-4bf8-a796-216ecf5aae9d req-667a658b-282e-4e76-a335-e65cd4c53bf2 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 753.241239] env[66364]: INFO networking_nsxv3.common.synchronization [req-9e216b60-1136-4bf8-a796-216ecf5aae9d req-667a658b-282e-4e76-a335-e65cd4c53bf2 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 753.241239] env[66364]: INFO networking_nsxv3.common.synchronization [req-9e216b60-1136-4bf8-a796-216ecf5aae9d req-667a658b-282e-4e76-a335-e65cd4c53bf2 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 753.241239] env[66364]: INFO networking_nsxv3.common.synchronization [req-9e216b60-1136-4bf8-a796-216ecf5aae9d req-667a658b-282e-4e76-a335-e65cd4c53bf2 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 with Priority: HIGHEST for action port [ 753.241239] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_rules [ 753.241488] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 753.241488] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 with Priority: HIGHEST for action port [ 753.241572] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 753.242090] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 753.242090] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.242090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.242258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.242593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.242705] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.243747] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.243862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.243927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.244324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.244410] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.245341] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6ff7002-5a0b-452d-891f-f4c697b8aad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.245450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.245560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.245683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.245751] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ff7002-5a0b-452d-891f-f4c697b8aad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.246600] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.246688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.246864] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.246941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.257233] env[66364]: INFO networking_nsxv3.common.synchronization [None req-f1c37124-487a-4a0d-9273-84a51713a24e None None] Enqueued Resource ID: 2f6de155-7c9b-432c-a3fc-6facd096fbd4 with Priority: HIGHEST for action port [ 753.258613] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f6de155-7c9b-432c-a3fc-6facd096fbd4 with Priority: HIGHEST for action port [ 753.259396] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f6de155-7c9b-432c-a3fc-6facd096fbd4 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.259530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f6de155-7c9b-432c-a3fc-6facd096fbd4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.259601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f6de155-7c9b-432c-a3fc-6facd096fbd4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.259848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f6de155-7c9b-432c-a3fc-6facd096fbd4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.259932] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f6de155-7c9b-432c-a3fc-6facd096fbd4',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.521581] env[66364]: INFO networking_nsxv3.common.synchronization [None req-522c729a-865d-4f83-81fb-2e5a80670366 None None] Enqueued Resource ID: b77f1fb9-397d-44a0-b090-0823d63944ea with Priority: HIGHEST for action port [ 753.523682] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b77f1fb9-397d-44a0-b090-0823d63944ea with Priority: HIGHEST for action port [ 753.524149] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-b77f1fb9-397d-44a0-b090-0823d63944ea taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.524288] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b77f1fb9-397d-44a0-b090-0823d63944ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.524366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b77f1fb9-397d-44a0-b090-0823d63944ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.524638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b77f1fb9-397d-44a0-b090-0823d63944ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.524959] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b77f1fb9-397d-44a0-b090-0823d63944ea',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.532691] env[66364]: INFO networking_nsxv3.common.synchronization [req-f1a0c84d-7d13-4afa-ba64-8636d49a8a13 req-8c0261ee-6f5a-4d69-a050-47fad60cd3b6 tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 753.534561] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 753.534561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.534561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.534561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.534561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.534561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.534561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.534561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.534561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.534561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.534561] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.563092] env[66364]: INFO networking_nsxv3.common.synchronization [req-f1a0c84d-7d13-4afa-ba64-8636d49a8a13 req-8c0261ee-6f5a-4d69-a050-47fad60cd3b6 tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 753.563299] env[66364]: INFO networking_nsxv3.common.synchronization [req-f1a0c84d-7d13-4afa-ba64-8636d49a8a13 req-8c0261ee-6f5a-4d69-a050-47fad60cd3b6 tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 753.563555] env[66364]: INFO networking_nsxv3.common.synchronization [req-f1a0c84d-7d13-4afa-ba64-8636d49a8a13 req-8c0261ee-6f5a-4d69-a050-47fad60cd3b6 tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 with Priority: HIGHEST for action port [ 753.564742] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 753.564933] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 753.565093] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 with Priority: HIGHEST for action port [ 753.565426] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.565575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.565673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.565862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.565943] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.566781] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.566879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.569990] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.569990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.569990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.569990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.569990] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.692039] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.694024] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.748932] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.748932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.748932] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6ff7002-5a0b-452d-891f-f4c697b8aad8 with status ACTIVE [ 753.748932] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.748932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.748932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.749235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.749235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.749235] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.749331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.749416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.749538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.749614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.749795] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.749886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.749943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.750095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.750168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.750249] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 is going to be updated. [ 753.751413] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.751508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.761597] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f6de155-7c9b-432c-a3fc-6facd096fbd4 [ 753.761817] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.761937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.761999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.762234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.762321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.762439] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f6de155-7c9b-432c-a3fc-6facd096fbd4 already deleted. [ 753.762846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f6de155-7c9b-432c-a3fc-6facd096fbd4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.776146] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.776146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.776146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.776146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.776146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.776146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.027745] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b77f1fb9-397d-44a0-b090-0823d63944ea [ 754.027745] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.027745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.027745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.027745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.028168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.028240] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b77f1fb9-397d-44a0-b090-0823d63944ea already deleted. [ 754.028382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b77f1fb9-397d-44a0-b090-0823d63944ea" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.036351] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.074038] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.074235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.074450] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 with status ACTIVE [ 754.074636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.074769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.074805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.075878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.075878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.075878] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.075878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.075878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.075878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.075878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.075878] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.076423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.076423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.076423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.076423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.076423] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 is going to be updated. [ 754.104272] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.105165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.105410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.106354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.107846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.108299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.193529] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.196988] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.545641] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.698804] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.698966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.699061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.699272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.699365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.699459] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 is going to be created. [ 754.701200] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.701295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.701352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.701531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.701630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.702274] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 754.736964] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.738553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.738553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.738553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.738553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.744114] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.744370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.744425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.744652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.744813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.754145] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: UNINITIALIZED for 2s [ 754.756439] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 754.815288] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: SUCCESS [ 754.816287] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c000df34-07b2-4015-b824-73615ee8d750 deletion is rescheduled due to dependency. [ 754.816546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.052011] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.052261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.052261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.052544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.052652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.052747] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 is going to be updated. [ 755.091445] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.091445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.091445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.091445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.091445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.104791] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: IN_PROGRESS for 2s [ 756.456952] env[66364]: INFO networking_nsxv3.common.synchronization [None req-a6770826-1abc-476e-84ff-39513ede2c5d None None] Enqueued Resource ID: c84a2f04-7001-4fce-b06b-eadda1f410cb with Priority: HIGHEST for action port [ 756.458103] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c84a2f04-7001-4fce-b06b-eadda1f410cb with Priority: HIGHEST for action port [ 756.458354] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c84a2f04-7001-4fce-b06b-eadda1f410cb taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.462243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c84a2f04-7001-4fce-b06b-eadda1f410cb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.462243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c84a2f04-7001-4fce-b06b-eadda1f410cb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.462243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c84a2f04-7001-4fce-b06b-eadda1f410cb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.462243] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c84a2f04-7001-4fce-b06b-eadda1f410cb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.615628] env[66364]: INFO networking_nsxv3.common.synchronization [None req-cdc2a9e7-07d6-4a0a-ad76-f0284674d9a4 tempest-ServerActionsV293TestJSON-383694888 tempest-ServerActionsV293TestJSON-383694888-project-member] Enqueued Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_rules [ 756.616891] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_rules [ 756.620152] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4749461-177d-4d2d-9817-47596fbff3b5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.620515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.620806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.621351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.621591] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.768604] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: SUCCESS [ 756.768604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.769091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.771021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.771021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.771021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.771021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.771021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.771021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.771021] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.774481] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 756.777912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.777912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.777912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.777912] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.777912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.777912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.779684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.779837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.779910] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.964618] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c84a2f04-7001-4fce-b06b-eadda1f410cb [ 756.965021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.965241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.965350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.965684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.965828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.965974] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c84a2f04-7001-4fce-b06b-eadda1f410cb already deleted. [ 756.966154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c84a2f04-7001-4fce-b06b-eadda1f410cb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.123337] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: SUCCESS [ 757.124923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.124923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.124923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.124923] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.124923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.124923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.124923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.124923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.124923] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.148756] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.148756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.148756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.148756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.148756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.148756] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4749461-177d-4d2d-9817-47596fbff3b5 already deleted. [ 757.148756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.282567] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.285548] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.334078] env[66364]: INFO networking_nsxv3.common.synchronization [None req-696c177a-a094-44ff-a3a1-75d656726c4c None None] Enqueued Resource ID: a8515c64-c7c5-4a59-be18-1839bd40b318 with Priority: HIGHEST for action port [ 757.334078] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8515c64-c7c5-4a59-be18-1839bd40b318 with Priority: HIGHEST for action port [ 757.334253] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8515c64-c7c5-4a59-be18-1839bd40b318 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.334404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8515c64-c7c5-4a59-be18-1839bd40b318" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.334486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8515c64-c7c5-4a59-be18-1839bd40b318" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.334752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8515c64-c7c5-4a59-be18-1839bd40b318" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.334833] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8515c64-c7c5-4a59-be18-1839bd40b318',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.628541] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.639375] env[66364]: INFO networking_nsxv3.common.synchronization [None req-4aef9490-53bb-4604-b570-b47f5de1aae9 tempest-ServerActionsV293TestJSON-383694888 tempest-ServerActionsV293TestJSON-383694888-project-member] Enqueued Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_rules [ 757.639946] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_rules [ 757.642328] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4749461-177d-4d2d-9817-47596fbff3b5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.642525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.643023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.643115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.643247] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.788698] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.790463] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.836536] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8515c64-c7c5-4a59-be18-1839bd40b318 [ 757.836723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.836849] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.838051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.838345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.838454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.838562] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8515c64-c7c5-4a59-be18-1839bd40b318 already deleted. [ 757.838643] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8515c64-c7c5-4a59-be18-1839bd40b318" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.132070] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.165722] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.165908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.165981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.166218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.166309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.166405] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4749461-177d-4d2d-9817-47596fbff3b5 already deleted. [ 758.166488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.222805] env[66364]: INFO networking_nsxv3.common.synchronization [req-56435ee6-5b4b-4424-84b0-db84618f8c2c req-f3219f42-3d9e-43ab-8f9b-84215515e587 tempest-ImagesNegativeTestJSON-327020873 tempest-ImagesNegativeTestJSON-327020873-project-member] Enqueued Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGHEST for action security_group_members [ 758.223522] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGHEST for action security_group_members [ 758.225039] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.229023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.229023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.229729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.229919] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.230619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.230707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.230908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.231008] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.231293] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0832a89a-abcf-4b2f-a153-b9b8672d1e5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.292477] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.292716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.292716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.292960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.293246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.293246] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 is going to be updated. [ 758.295055] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.295244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.295244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.295494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.295708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.295856] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 758.340046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.340046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.340046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.340046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.340046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.340046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.340046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.340046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.340046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.340046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.351177] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: IN_PROGRESS for 2s [ 758.351883] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 758.635871] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.635871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.635871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.635871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.635871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.635871] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 is going to be updated. [ 758.665762] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.665908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.665976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.666201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.666347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.676102] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: IN_PROGRESS for 2s [ 758.735605] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.735738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.735786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.736033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.736128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.737063] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.738855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.738855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.738855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.738855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.738855] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d already deleted. [ 758.738855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.536420] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-363 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.536937] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-363" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.537268] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-363" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.537548] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-363" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.538132] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.539317] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.539317] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.539317] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.539317] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.539317] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.539317] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.539949] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.539949] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.539949] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.540143] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.540349] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.561912] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.562100] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.562514] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.562514] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-363" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.562728] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-6a09709b-6dc2-443a-9c64-154665f714e3 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.562898] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-6a09709b-6dc2-443a-9c64-154665f714e3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.563018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-6a09709b-6dc2-443a-9c64-154665f714e3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.563354] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-6a09709b-6dc2-443a-9c64-154665f714e3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.563526] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a09709b-6dc2-443a-9c64-154665f714e3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.028639] env[66364]: INFO networking_nsxv3.common.synchronization [req-57c7941c-73fb-4b91-8021-f33eb14b012e req-6a070de9-7250-4592-a261-21605ddaeda5 tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 760.030540] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 760.030540] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.030540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.030540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.030802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.030966] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.031111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.031111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.031240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.031339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.032340] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.066817] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.066817] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.066817] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.067199] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.067199] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.067199] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 6a09709b-6dc2-443a-9c64-154665f714e3 not found, creating... [ 760.067449] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.067882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.067882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.067882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.068097] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.068279] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.068427] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.068536] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.068736] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.068862] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.068992] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 6a09709b-6dc2-443a-9c64-154665f714e3 is going to be created. [ 760.090900] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.091134] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.091213] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.091487] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.091710] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.091924] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-6a09709b-6dc2-443a-9c64-154665f714e3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.189021] env[66364]: INFO networking_nsxv3.common.synchronization [None req-de1df67f-3218-443b-91dd-efa12682c565 None None] Enqueued Resource ID: e94edd2c-09d6-4bfd-b723-06bcbb5c003b with Priority: HIGHEST for action port [ 760.189021] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e94edd2c-09d6-4bfd-b723-06bcbb5c003b with Priority: HIGHEST for action port [ 760.189021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e94edd2c-09d6-4bfd-b723-06bcbb5c003b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.189411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e94edd2c-09d6-4bfd-b723-06bcbb5c003b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.189579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e94edd2c-09d6-4bfd-b723-06bcbb5c003b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.190231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e94edd2c-09d6-4bfd-b723-06bcbb5c003b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.190614] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e94edd2c-09d6-4bfd-b723-06bcbb5c003b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.366792] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: SUCCESS [ 760.367818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.367818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.368316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.368800] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.369062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.369062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.369432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.369432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.369432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.369684] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.371656] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 760.372139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.372199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.372342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.372621] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.373021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.373021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.373334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.373483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.373585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.373783] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.533867] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.687247] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: SUCCESS [ 760.687459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.687628] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.687959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.688176] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.688299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.688368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.688532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.688617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.688703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.688791] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.694496] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e94edd2c-09d6-4bfd-b723-06bcbb5c003b [ 760.694694] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.694820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.694885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.695108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.695203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.695285] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e94edd2c-09d6-4bfd-b723-06bcbb5c003b already deleted. [ 760.695364] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e94edd2c-09d6-4bfd-b723-06bcbb5c003b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.767148] env[66364]: INFO networking_nsxv3.common.synchronization [req-57c7941c-73fb-4b91-8021-f33eb14b012e req-3508f950-9130-45e8-abe7-4b897f575c24 tempest-ServersTestMultiNic-1749431682 tempest-ServersTestMultiNic-1749431682-project-member] Enqueued Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 760.768070] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b with Priority: HIGHEST for action security_group_members [ 760.768070] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-64957bc0-2496-43d3-8cbd-8653bab5f68b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.768254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.783929] env[66364]: INFO networking_nsxv3.common.synchronization [req-56435ee6-5b4b-4424-84b0-db84618f8c2c req-52bf8c83-6a1e-47d3-ad70-601a0efe1124 service nova] Enqueued Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGHEST for action security_group_rules [ 760.783993] env[66364]: INFO networking_nsxv3.common.synchronization [req-56435ee6-5b4b-4424-84b0-db84618f8c2c req-52bf8c83-6a1e-47d3-ad70-601a0efe1124 service nova] Enqueued Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGHEST for action security_group_members [ 760.784123] env[66364]: INFO networking_nsxv3.common.synchronization [req-56435ee6-5b4b-4424-84b0-db84618f8c2c req-52bf8c83-6a1e-47d3-ad70-601a0efe1124 service nova] Enqueued Resource ID: 6a09709b-6dc2-443a-9c64-154665f714e3 with Priority: HIGHEST for action port [ 760.784538] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGHEST for action security_group_rules [ 760.784668] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGHEST for action security_group_members [ 760.784766] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a09709b-6dc2-443a-9c64-154665f714e3 with Priority: HIGHEST for action port [ 760.785265] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.785384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.785447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.785689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.785811] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0832a89a-abcf-4b2f-a153-b9b8672d1e5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.786992] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.787155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.787345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.787451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.787621] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.787719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.787780] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.787928] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.788020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.788218] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0832a89a-abcf-4b2f-a153-b9b8672d1e5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.789243] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a09709b-6dc2-443a-9c64-154665f714e3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.789243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a09709b-6dc2-443a-9c64-154665f714e3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.789243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a09709b-6dc2-443a-9c64-154665f714e3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.789463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a09709b-6dc2-443a-9c64-154665f714e3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.789557] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a09709b-6dc2-443a-9c64-154665f714e3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.872933] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.878234] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.878368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.878452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.878726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.878804] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.878902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.878962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.879153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.879236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.879318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.879457] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.879545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.879599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.879776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.882854] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.882854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.882854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.882854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.882854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.882854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.882854] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.036325] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.112578] env[66364]: INFO networking_nsxv3.common.synchronization [req-561193a8-de06-44f4-b016-c3dac0ada250 req-238c2a2a-66bc-4eb9-95c4-97bbae217e18 tempest-SecurityGroupRulesTestJSON-1991974859 tempest-SecurityGroupRulesTestJSON-1991974859-project-member] Enqueued Resource ID: 2bebcac8-f17f-4c0a-bbc9-f043b199cdfe with Priority: HIGHEST for action security_group_rules [ 761.112578] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bebcac8-f17f-4c0a-bbc9-f043b199cdfe with Priority: HIGHEST for action security_group_rules [ 761.112578] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bebcac8-f17f-4c0a-bbc9-f043b199cdfe taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.113068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bebcac8-f17f-4c0a-bbc9-f043b199cdfe" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.113190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bebcac8-f17f-4c0a-bbc9-f043b199cdfe" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.113460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bebcac8-f17f-4c0a-bbc9-f043b199cdfe" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.113556] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bebcac8-f17f-4c0a-bbc9-f043b199cdfe',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.191214] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.294579] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.294579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.294579] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0832a89a-abcf-4b2f-a153-b9b8672d1e5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.295407] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a09709b-6dc2-443a-9c64-154665f714e3 with status ACTIVE [ 761.295812] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.295812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.295812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.296081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.296214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.297472] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.297472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.297472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.297472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.297472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.301116] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.301116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.301116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.301116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.301116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.301116] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a09709b-6dc2-443a-9c64-154665f714e3 is going to be updated. [ 761.325301] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.325412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.325412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.325626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.325746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.325871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a09709b-6dc2-443a-9c64-154665f714e3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.378418] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63a02b41-2b51-4fad-96f6-6707b3bc8ff7: rpc.has_security_group_logging(os_id): False [ 761.386146] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0ef17dd-12b4-4751-91bb-321b509b882e: rpc.has_security_group_logging(os_id): False [ 761.405721] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.405721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.405721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.405721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.405721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.405721] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.405721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.405721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.405721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.405721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.405721] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 is going to be created. [ 761.408331] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.408630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.408785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.409069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.409283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.409736] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.411066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.411066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.411066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.411066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.411066] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.411066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.411066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.411506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.411708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.412031] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.412271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.412457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.414116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.414116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.414116] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 761.493754] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.493968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.493968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.494218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.494396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.498450] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.498725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.498725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.499023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.499086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.510407] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: IN_PROGRESS for 2s [ 761.521310] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 761.540912] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.541183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.541262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.541637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.541749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.541842] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 761.586594] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.586594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.586594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.586926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.586926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.606127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 761.645067] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.645067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.645067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.645067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.645067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.645067] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bebcac8-f17f-4c0a-bbc9-f043b199cdfe already deleted. [ 761.645067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bebcac8-f17f-4c0a-bbc9-f043b199cdfe" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.694402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce5e068-6071-492c-83e7-d1b6b7551653: rpc.has_security_group_logging(os_id): False [ 761.721145] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.721369] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.721369] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.722033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.722033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.722033] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.722033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.722258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.722258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.722368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.722368] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 is going to be updated. [ 761.786816] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.787197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.787417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.787712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.788546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.802520] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0832a89a-abcf-4b2f-a153-b9b8672d1e5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.805801] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: IN_PROGRESS for 2s [ 762.306608] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.307228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.307228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.307998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.307998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.307998] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d is going to be created. [ 762.345672] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.345672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.345672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.345672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.345672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.363396] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d in Status: UNINITIALIZED for 2s [ 762.467413] env[66364]: INFO networking_nsxv3.common.synchronization [None req-fbeeff21-b1c8-44ed-b475-d9e124c18d3b None None] Enqueued Resource ID: ffc0adfa-4aa1-4c50-8fed-246a891e9697 with Priority: HIGHEST for action port [ 762.468634] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc0adfa-4aa1-4c50-8fed-246a891e9697 with Priority: HIGHEST for action port [ 762.469417] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffc0adfa-4aa1-4c50-8fed-246a891e9697 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.470036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffc0adfa-4aa1-4c50-8fed-246a891e9697" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.470242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffc0adfa-4aa1-4c50-8fed-246a891e9697" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.470852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffc0adfa-4aa1-4c50-8fed-246a891e9697" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.471178] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc0adfa-4aa1-4c50-8fed-246a891e9697',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.978634] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffc0adfa-4aa1-4c50-8fed-246a891e9697 [ 762.978772] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.978985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.979132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.979665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.979665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.979820] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffc0adfa-4aa1-4c50-8fed-246a891e9697 already deleted. [ 762.979891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffc0adfa-4aa1-4c50-8fed-246a891e9697" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.206090] env[66364]: INFO networking_nsxv3.common.synchronization [req-108a4896-f1ff-4296-9dfb-9b40b7a58049 req-a4a2e69c-bf1c-4927-9046-c19b56766b6a tempest-SecurityGroupRulesNegativeTestJSON-5869534 tempest-SecurityGroupRulesNegativeTestJSON-5869534-project-member] Enqueued Resource ID: e6c54d2c-21a2-44a5-b2f2-413e53585840 with Priority: HIGHEST for action security_group_rules [ 763.206720] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c54d2c-21a2-44a5-b2f2-413e53585840 with Priority: HIGHEST for action security_group_rules [ 763.207040] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6c54d2c-21a2-44a5-b2f2-413e53585840 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.207200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6c54d2c-21a2-44a5-b2f2-413e53585840" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.207311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6c54d2c-21a2-44a5-b2f2-413e53585840" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.207768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6c54d2c-21a2-44a5-b2f2-413e53585840" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.207768] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6c54d2c-21a2-44a5-b2f2-413e53585840',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.526209] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: SUCCESS [ 763.526494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.537916] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 763.538760] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.617824] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 763.618112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.618330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.618551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.618739] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.618862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.618920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.619111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.619191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.619288] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64957bc0-2496-43d3-8cbd-8653bab5f68b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.732245] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.732676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.732676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.733033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.733033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.733133] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6c54d2c-21a2-44a5-b2f2-413e53585840 already deleted. [ 763.733209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6c54d2c-21a2-44a5-b2f2-413e53585840" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.822361] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: SUCCESS [ 763.822582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.121989] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.122255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.122352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.122717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.122802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.123056] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.123174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.123245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.123420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.123519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.123619] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b is going to be updated. [ 764.152411] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.152720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.152801] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.153055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.153219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.164677] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: IN_PROGRESS for 2s [ 764.379270] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d in Status: SUCCESS [ 764.379270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.379270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.379270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.379270] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.379270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.379270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.379270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.379619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.379619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.379692] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0832a89a-abcf-4b2f-a153-b9b8672d1e5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.882296] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.882590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.882590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.883784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.883784] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.883784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.883784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.883784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.883784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.883784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.883784] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.883784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.883784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.884143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.884143] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.884143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.884231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.884295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.884366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.884445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.884842] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0832a89a-abcf-4b2f-a153-b9b8672d1e5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.926210] env[66364]: INFO networking_nsxv3.common.synchronization [req-b22e1454-a9d1-45c0-a610-24ccc4a6da91 req-b5ce61de-66d0-4c7e-8545-8fe692bd19f7 tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 764.926711] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 764.927010] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.927461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.927532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.927762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.927920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.928023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.928083] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.928227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.928308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.928396] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.947725] env[66364]: INFO networking_nsxv3.common.synchronization [req-b22e1454-a9d1-45c0-a610-24ccc4a6da91 req-b5ce61de-66d0-4c7e-8545-8fe692bd19f7 tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 764.947951] env[66364]: INFO networking_nsxv3.common.synchronization [req-b22e1454-a9d1-45c0-a610-24ccc4a6da91 req-b5ce61de-66d0-4c7e-8545-8fe692bd19f7 tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 764.948113] env[66364]: INFO networking_nsxv3.common.synchronization [req-b22e1454-a9d1-45c0-a610-24ccc4a6da91 req-b5ce61de-66d0-4c7e-8545-8fe692bd19f7 tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 with Priority: HIGHEST for action port [ 764.948729] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_rules [ 764.948870] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 764.948967] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 with Priority: HIGHEST for action port [ 764.949944] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.949944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.949944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.950541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.950541] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.951725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.951725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.951725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.951725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.951725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.951942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.951942] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.388221] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0832a89a-abcf-4b2f-a153-b9b8672d1e5d: rpc.has_security_group_logging(os_id): False [ 765.408197] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.408197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.408392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.408443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.408658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.408740] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.408859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.408943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.409102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.409205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.409357] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.409449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.409500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.409635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.409710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.409884] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.409974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.410191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.410191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.410298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.410360] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d is going to be created. [ 765.431558] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.457357] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.457357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.460312] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 with status ACTIVE [ 765.461604] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.461604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.461604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.461604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.461604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.461604] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.461604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.461604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.462044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.462044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.464572] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.464572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.464693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.464802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.464881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.464969] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766 is going to be updated. [ 765.485487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.485487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.485487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.485487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.485487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.499176] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.499176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.499176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.499440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.499505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.499662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a9fd5be-30ea-4a47-8f88-c2b7bbf3f766" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.500445] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d in Status: IN_PROGRESS for 2s [ 765.934707] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.177419] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b in Status: SUCCESS [ 766.177576] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64957bc0-2496-43d3-8cbd-8653bab5f68b deletion is rescheduled due to dependency. [ 766.177612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64957bc0-2496-43d3-8cbd-8653bab5f68b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.440571] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.440785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.444021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.444021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.444021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.444021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 is going to be updated. [ 766.478485] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.478636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.478703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.478917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.479076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.492628] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: IN_PROGRESS for 2s [ 766.650952] env[66364]: INFO networking_nsxv3.common.synchronization [req-bd08fc1a-6fca-44b1-be3c-8ec32d512637 req-df313eb4-0ff5-4f04-a8ba-6b860f91f7bf tempest-SecurityGroupRulesTestJSON-1991974859 tempest-SecurityGroupRulesTestJSON-1991974859-project-member] Enqueued Resource ID: 99b64270-6dab-4e9e-b776-0c3fc4434789 with Priority: HIGHEST for action security_group_rules [ 766.651573] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99b64270-6dab-4e9e-b776-0c3fc4434789 with Priority: HIGHEST for action security_group_rules [ 766.652329] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-99b64270-6dab-4e9e-b776-0c3fc4434789 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.652419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-99b64270-6dab-4e9e-b776-0c3fc4434789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.653025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-99b64270-6dab-4e9e-b776-0c3fc4434789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.653025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-99b64270-6dab-4e9e-b776-0c3fc4434789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.653025] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('99b64270-6dab-4e9e-b776-0c3fc4434789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.736503] env[66364]: INFO networking_nsxv3.common.synchronization [req-1cafa333-a557-4e19-b699-a152c38bde85 req-4e81f197-0bc3-4f15-a2a8-b8c13feeccda tempest-SecurityGroupRulesNegativeTestJSON-5869534 tempest-SecurityGroupRulesNegativeTestJSON-5869534-project-member] Enqueued Resource ID: e6c54d2c-21a2-44a5-b2f2-413e53585840 with Priority: HIGHEST for action security_group_rules [ 766.737101] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6c54d2c-21a2-44a5-b2f2-413e53585840 with Priority: HIGHEST for action security_group_rules [ 766.737500] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6c54d2c-21a2-44a5-b2f2-413e53585840 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.737663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6c54d2c-21a2-44a5-b2f2-413e53585840" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.737728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6c54d2c-21a2-44a5-b2f2-413e53585840" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.737931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6c54d2c-21a2-44a5-b2f2-413e53585840" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.737999] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6c54d2c-21a2-44a5-b2f2-413e53585840',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.175222] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.175656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.175656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.175787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.175787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.175888] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 99b64270-6dab-4e9e-b776-0c3fc4434789 already deleted. [ 767.175973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-99b64270-6dab-4e9e-b776-0c3fc4434789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.265231] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.265416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.265457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.266057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.266057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.266057] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6c54d2c-21a2-44a5-b2f2-413e53585840 already deleted. [ 767.266057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6c54d2c-21a2-44a5-b2f2-413e53585840" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.512717] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d in Status: SUCCESS [ 767.512953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.684999] env[66364]: INFO networking_nsxv3.common.synchronization [req-cb9fe62f-ab59-415e-89a9-e940102b3ae3 req-e7752344-2912-4dad-9f2a-1cec7f9cf844 tempest-MigrationsAdminTest-172536833 tempest-MigrationsAdminTest-172536833-project-member] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 767.685565] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 767.685881] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.685996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.686392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.686602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.686760] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.686876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.686909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.687096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.687142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.687231] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.190645] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.240355] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.240557] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.240669] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.241146] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.241793] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.242068] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.242223] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.242595] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.242784] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.243265] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.243419] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.243561] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.243730] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.243864] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.243997] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.244172] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.287024] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.287024] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.287024] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.287024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.287024] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-422d36fe-eeed-422b-a64d-23f02a1b158a taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.287024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-422d36fe-eeed-422b-a64d-23f02a1b158a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.287024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-422d36fe-eeed-422b-a64d-23f02a1b158a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.287024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-422d36fe-eeed-422b-a64d-23f02a1b158a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.287024] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('422d36fe-eeed-422b-a64d-23f02a1b158a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.506342] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: SUCCESS [ 768.507023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.507828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.507969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.508333] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.508501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.508622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.508905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.509098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.509292] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.693377] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.790474] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.790869] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.791870] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.792349] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.793352] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.793352] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 422d36fe-eeed-422b-a64d-23f02a1b158a not found, creating... [ 768.794215] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.794468] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.794661] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.794992] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.795224] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.795580] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.795813] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.795969] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.796276] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.796556] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.797422] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 422d36fe-eeed-422b-a64d-23f02a1b158a is going to be created. [ 768.822301] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.822301] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.822301] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.822301] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.822301] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.822619] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-422d36fe-eeed-422b-a64d-23f02a1b158a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.011663] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.195441] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.195768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.195768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.195950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.196073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.196171] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 is going to be updated. [ 769.230990] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.231186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.231250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.231443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.231627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.248739] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: IN_PROGRESS for 2s [ 769.411089] env[66364]: INFO networking_nsxv3.common.synchronization [req-343c29dc-eef0-473a-80c0-8ac5d6bbfa50 req-06c37a34-df1a-4405-8db3-4803afc58ba6 tempest-ListServerFiltersTestJSON-936474167 tempest-ListServerFiltersTestJSON-936474167-project-member] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 769.411290] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 769.411885] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.411885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.411885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.412361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.412430] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.412706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.412706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.412907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.413035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.413164] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.514908] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.549883] env[66364]: INFO networking_nsxv3.common.synchronization [req-cb9fe62f-ab59-415e-89a9-e940102b3ae3 req-424f038a-de7f-40c9-ba05-aee070866a88 service nova] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_rules [ 769.550215] env[66364]: INFO networking_nsxv3.common.synchronization [req-cb9fe62f-ab59-415e-89a9-e940102b3ae3 req-424f038a-de7f-40c9-ba05-aee070866a88 service nova] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 769.550543] env[66364]: INFO networking_nsxv3.common.synchronization [req-cb9fe62f-ab59-415e-89a9-e940102b3ae3 req-424f038a-de7f-40c9-ba05-aee070866a88 service nova] Enqueued Resource ID: 422d36fe-eeed-422b-a64d-23f02a1b158a with Priority: HIGHEST for action port [ 769.551371] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_rules [ 769.551605] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 769.551778] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 422d36fe-eeed-422b-a64d-23f02a1b158a with Priority: HIGHEST for action port [ 769.552212] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.552394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.552550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.552893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.553174] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.554762] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.554937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.555840] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-422d36fe-eeed-422b-a64d-23f02a1b158a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.556018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-422d36fe-eeed-422b-a64d-23f02a1b158a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.556131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-422d36fe-eeed-422b-a64d-23f02a1b158a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.556435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-422d36fe-eeed-422b-a64d-23f02a1b158a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.556578] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('422d36fe-eeed-422b-a64d-23f02a1b158a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.915720] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.019258] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.019258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.019258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.019258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.019258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.019258] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 is going to be updated. [ 770.050485] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.051459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.051582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.051995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.052190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.059303] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.060275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.060275] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 422d36fe-eeed-422b-a64d-23f02a1b158a with status ACTIVE [ 770.060435] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.060523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.060523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.060897] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.060897] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.061098] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.061179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.061286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.061427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.061503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.061710] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.061820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.061901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.062072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.062162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.062251] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 422d36fe-eeed-422b-a64d-23f02a1b158a is going to be updated. [ 770.065489] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: IN_PROGRESS for 2s [ 770.088302] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.088579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.088579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.088981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.088981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.089449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-422d36fe-eeed-422b-a64d-23f02a1b158a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.160923] env[66364]: INFO networking_nsxv3.common.synchronization [req-6fccc81b-d47b-4fca-b55e-0c8b44c0046f req-0f7b8bd8-6c95-46ac-92c2-ef9da2b71e9c tempest-ServersWithSpecificFlavorTestJSON-596773426 tempest-ServersWithSpecificFlavorTestJSON-596773426-project-member] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 770.161338] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 770.162052] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.162052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.162052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.162279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.162480] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.162628] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.162724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.162963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.163112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.163248] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.419832] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.484413] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 770.484413] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 770.484413] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 with Priority: HIGHEST for action security_group_members [ 770.484990] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 770.486555] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 770.486749] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 with Priority: HIGHEST for action security_group_members [ 770.486941] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.487075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.487138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.487336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.487554] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.487602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.487686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.487950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.487950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.487950] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.488831] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.488950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.489016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.489160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.489303] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.489395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.489453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.489885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.489977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.490191] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.490943] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5844c9d-c196-40e8-9a43-e89d1e60d237 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.491065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.491126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.491322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.491779] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.491779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.491779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.491779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.492403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.492403] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.531610] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_rules [ 770.531778] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 770.531914] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 770.532054] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 770.532178] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 with Priority: HIGHEST for action security_group_rules [ 770.532294] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 with Priority: HIGHEST for action security_group_members [ 770.535444] env[66364]: INFO networking_nsxv3.common.synchronization [req-34836239-58de-4708-9f11-1e1e410ffd16 req-818ad995-248d-4c10-907c-e0738edc39d8 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 with Priority: HIGHEST for action port [ 770.535444] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_rules [ 770.535444] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_rules [ 770.535444] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 with Priority: HIGHEST for action security_group_members [ 770.535444] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 with Priority: HIGHEST for action port [ 770.535444] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 with Priority: HIGHEST for action security_group_rules [ 770.535444] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 770.535444] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 770.535984] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.535984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.535984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.536117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.536117] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.537771] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.537890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.537968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.539807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.539807] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.539807] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5844c9d-c196-40e8-9a43-e89d1e60d237 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.539807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.540109] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6ff7002-5a0b-452d-891f-f4c697b8aad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.540260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.540340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.540572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.540678] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ff7002-5a0b-452d-891f-f4c697b8aad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.542220] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5844c9d-c196-40e8-9a43-e89d1e60d237 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.542220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.542220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.542220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.542449] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.543707] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.543707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.543707] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.543707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.666036] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.666036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.666036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.666366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.666503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.666702] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.666804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.666900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.667046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.667124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.667329] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37506c58-083d-46d9-8010-be6545a2e954 is going to be updated. [ 770.695957] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.696130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.696196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.696407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.696537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.706216] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: IN_PROGRESS for 2s [ 770.922131] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.922304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.922371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.922650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.922997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.923129] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be updated. [ 770.962538] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.962730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.962798] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.963700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.963700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.966747] env[66364]: INFO networking_nsxv3.common.synchronization [req-1dc3e7ae-6699-43d8-a601-5550cd008026 req-b0042f17-a09c-4291-ad07-a6cec477f758 tempest-InstanceActionsV221TestJSON-1268642956 tempest-InstanceActionsV221TestJSON-1268642956-project-member] Enqueued Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGHEST for action security_group_members [ 770.967841] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGHEST for action security_group_members [ 770.968187] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd2e240-52bb-4f71-913f-ee703bf06524 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.968857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.968971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.969383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.969710] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.969869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.970458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.970458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.970458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.970458] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abd2e240-52bb-4f71-913f-ee703bf06524',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.973881] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 770.993939] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.994693] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.995368] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.045269] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.045398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.045717] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.045914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.045997] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6ff7002-5a0b-452d-891f-f4c697b8aad8 with status ACTIVE [ 771.046180] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.046285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.046343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.046549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.046636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.046879] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.046879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.046977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.047366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.047366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.048750] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.048750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.048750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.048750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.048750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.048750] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6ff7002-5a0b-452d-891f-f4c697b8aad8 is going to be updated. [ 771.053135] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5844c9d-c196-40e8-9a43-e89d1e60d237 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.054073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.071703] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.071848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.071920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.072151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.072304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.072460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6ff7002-5a0b-452d-891f-f4c697b8aad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.270029] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: SUCCESS [ 771.270029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.270029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.270029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.270029] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.270636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.270636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.270636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.270636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.270636] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.431421] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-807 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.431784] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-807" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.431784] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-807" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.432527] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-807" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.432527] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.432527] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.432827] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.432884] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.433054] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.433230] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.433337] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.433433] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.433527] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.433626] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.433718] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.433838] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.458807] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.458985] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.459131] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.459301] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-807" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.459612] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-0e70204e-bd9a-42b9-bb77-5c524ac616c8 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.459762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-0e70204e-bd9a-42b9-bb77-5c524ac616c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.459873] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-0e70204e-bd9a-42b9-bb77-5c524ac616c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.460292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-0e70204e-bd9a-42b9-bb77-5c524ac616c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.460427] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e70204e-bd9a-42b9-bb77-5c524ac616c8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.472121] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.472315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.472385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.472646] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.472745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.472952] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.473076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.473173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.473302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.473378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.473461] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abd2e240-52bb-4f71-913f-ee703bf06524 already deleted. [ 771.473565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.501113] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.502258] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.503485] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.776422] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.964753] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.964880] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.964986] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.965592] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.965743] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.965897] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 0e70204e-bd9a-42b9-bb77-5c524ac616c8 not found, creating... [ 771.966180] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.966450] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.966450] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.966681] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.966813] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.967097] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.967248] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.967355] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.967546] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.967849] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.967849] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 0e70204e-bd9a-42b9-bb77-5c524ac616c8 is going to be created. [ 771.990754] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.990754] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.990754] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.990754] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.990754] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.990754] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-0e70204e-bd9a-42b9-bb77-5c524ac616c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.007822] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.009725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.009725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.009725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.009725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.009725] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 is going to be updated. [ 772.010728] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.010728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.010728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.010728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.010728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.010728] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 772.012377] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.012504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.013139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.013139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.013139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.013139] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 is going to be created. [ 772.048714] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.048865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.048922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.049255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.049327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.067415] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.067564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.067564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.067763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.067905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.071921] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.072109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.072109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.076027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.076027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.076027] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 in Status: UNINITIALIZED for 2s [ 772.084402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 772.092728] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: IN_PROGRESS for 2s [ 772.094273] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: SUCCESS [ 772.094273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.094273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.094273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.094510] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.094510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.094597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.096175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.096175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.096175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.096175] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.281368] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.566173] env[66364]: INFO networking_nsxv3.common.synchronization [req-d8cae961-5809-46c6-93ea-0e6c10ec4959 req-a95035f2-3803-45bf-bce1-6c584c8274ee tempest-AttachInterfacesUnderV243Test-1253159964 tempest-AttachInterfacesUnderV243Test-1253159964-project-member] Enqueued Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 772.567366] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 with Priority: HIGHEST for action security_group_members [ 772.567366] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce5e068-6071-492c-83e7-d1b6b7551653 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.567899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.567899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.568103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.568294] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.568423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.568487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.568676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.568790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.568881] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.597488] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce5e068-6071-492c-83e7-d1b6b7551653',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.720314] env[66364]: INFO networking_nsxv3.common.synchronization [req-1dc3e7ae-6699-43d8-a601-5550cd008026 req-3c4144af-57fa-43d4-bc46-d2373b6c59b4 service nova] Enqueued Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGHEST for action security_group_rules [ 772.721569] env[66364]: INFO networking_nsxv3.common.synchronization [req-1dc3e7ae-6699-43d8-a601-5550cd008026 req-3c4144af-57fa-43d4-bc46-d2373b6c59b4 service nova] Enqueued Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGHEST for action security_group_members [ 772.721854] env[66364]: INFO networking_nsxv3.common.synchronization [req-1dc3e7ae-6699-43d8-a601-5550cd008026 req-3c4144af-57fa-43d4-bc46-d2373b6c59b4 service nova] Enqueued Resource ID: 0e70204e-bd9a-42b9-bb77-5c524ac616c8 with Priority: HIGHEST for action port [ 772.726031] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: SUCCESS [ 772.726031] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37506c58-083d-46d9-8010-be6545a2e954 deletion is rescheduled due to dependency. [ 772.726031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.728563] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGHEST for action security_group_rules [ 772.728563] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGHEST for action security_group_members [ 772.728563] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e70204e-bd9a-42b9-bb77-5c524ac616c8 with Priority: HIGHEST for action port [ 772.728685] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abd2e240-52bb-4f71-913f-ee703bf06524 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.728747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.728796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.730940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.730940] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abd2e240-52bb-4f71-913f-ee703bf06524',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.730940] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd2e240-52bb-4f71-913f-ee703bf06524 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.730940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.730940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.730940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.731405] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.731405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.731405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.731510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.731719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.731719] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abd2e240-52bb-4f71-913f-ee703bf06524',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.732794] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e70204e-bd9a-42b9-bb77-5c524ac616c8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.732912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e70204e-bd9a-42b9-bb77-5c524ac616c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.733022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e70204e-bd9a-42b9-bb77-5c524ac616c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.733132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e70204e-bd9a-42b9-bb77-5c524ac616c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.734711] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e70204e-bd9a-42b9-bb77-5c524ac616c8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.784469] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.784649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.784686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.784883] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.784962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.785077] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 is going to be updated. [ 772.818413] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.818623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.818696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.819035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.819141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.829946] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: IN_PROGRESS for 2s [ 772.989393] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 772.989526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.071295] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.073048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.073048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.073048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.073048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.073048] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.073048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.073048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.073048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.073048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.073048] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 is going to be updated. [ 773.102753] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce5e068-6071-492c-83e7-d1b6b7551653: rpc.has_security_group_logging(os_id): False [ 773.104207] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.104326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.104396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.104599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.104861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.116529] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: IN_PROGRESS for 2s [ 773.125121] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.125309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.125374] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.125589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.125742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.125998] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.126130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.126211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.126402] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.126506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.126611] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 is going to be updated. [ 773.208839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.210508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.210699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.210962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.211174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.235349] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abd2e240-52bb-4f71-913f-ee703bf06524',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.237113] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd2e240-52bb-4f71-913f-ee703bf06524 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.237113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.237113] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e70204e-bd9a-42b9-bb77-5c524ac616c8 with status ACTIVE [ 773.237113] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.237113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.237417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.237417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.237477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.237619] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.237710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.239023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.239023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.239023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.239023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.239023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.239023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.239023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.239023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.239023] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e70204e-bd9a-42b9-bb77-5c524ac616c8 is going to be updated. [ 773.242510] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: IN_PROGRESS for 2s [ 773.278719] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.278719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.278719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.278719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.278982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.279042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e70204e-bd9a-42b9-bb77-5c524ac616c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.386174] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NSXv3 Agent Agent loop - iteration:0 completed [ 773.386349] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NSXv3 Agent Agent loop - iteration:1 started [ 773.500291] env[66364]: INFO networking_nsxv3.common.synchronization [req-73144f46-6aa2-4142-ae6f-1bae432de696 req-295383ff-1f48-4828-8d74-490524ac3ed0 tempest-ServersTestJSON-1686957391 tempest-ServersTestJSON-1686957391-project-member] Enqueued Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_members [ 773.501173] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_members [ 773.501578] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.501715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.501773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.502145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.502344] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.502496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.502635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.502848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.502951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.503066] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.667506] env[66364]: INFO networking_nsxv3.common.synchronization [req-1b34536d-7a8a-498b-90cd-e5b105d8eb0d req-c973fed8-6f00-4ec2-8fc6-f2f2e03668b6 tempest-SecurityGroupRulesTestJSON-1991974859 tempest-SecurityGroupRulesTestJSON-1991974859-project-member] Enqueued Resource ID: 6d3aacfd-b042-49be-8924-5503b26f252c with Priority: HIGHEST for action security_group_rules [ 773.667506] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3aacfd-b042-49be-8924-5503b26f252c with Priority: HIGHEST for action security_group_rules [ 773.668193] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3aacfd-b042-49be-8924-5503b26f252c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.668409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.668555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.668866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.669026] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3aacfd-b042-49be-8924-5503b26f252c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.740808] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abd2e240-52bb-4f71-913f-ee703bf06524',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.919138] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.919138] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-160" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.919138] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-160" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.919138] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-160" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.919138] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.920024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.920275] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.920551] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.920742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.920915] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.921030] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.921138] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.921398] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.921438] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.921556] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.921719] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.959508] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.959740] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.959904] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.960198] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-160" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.960594] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-2170eccf-920d-4495-a634-3e0fb5fb22b8 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.961542] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-2170eccf-920d-4495-a634-3e0fb5fb22b8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.961710] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-2170eccf-920d-4495-a634-3e0fb5fb22b8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.962135] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-2170eccf-920d-4495-a634-3e0fb5fb22b8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.962456] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2170eccf-920d-4495-a634-3e0fb5fb22b8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.005575] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.005764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.005764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.005764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.006058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.006566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.006713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.006801] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.006978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.007099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.007155] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 already deleted. [ 774.007252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.088591] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 in Status: SUCCESS [ 774.088921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.089204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.089503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.090206] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.090372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.090453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.090666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.090774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.090928] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.103037] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: SUCCESS [ 774.103037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.103037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.103037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.103262] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.103323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.103369] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.103504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.103650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.103713] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.105367] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 774.105788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.105788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.105918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.106050] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.106448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.106448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.106448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.106448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.106612] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.190924] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.191154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.191229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.191492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.191622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.191753] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3aacfd-b042-49be-8924-5503b26f252c already deleted. [ 774.191871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.248060] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.248225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.248295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.248503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.248594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.248691] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abd2e240-52bb-4f71-913f-ee703bf06524 is going to be created. [ 774.273838] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.273979] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.274938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.275214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.275384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.288766] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abd2e240-52bb-4f71-913f-ee703bf06524 in Status: UNINITIALIZED for 2s [ 774.465498] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.465788] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.465829] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.466469] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.466469] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.466673] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 2170eccf-920d-4495-a634-3e0fb5fb22b8 not found, creating... [ 774.467042] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.467252] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.467391] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.467731] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.467942] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.468357] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.468896] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.469078] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.469078] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.469587] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.469793] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 2170eccf-920d-4495-a634-3e0fb5fb22b8 is going to be created. [ 774.496089] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.496351] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.496401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.496697] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.496920] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.497146] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-2170eccf-920d-4495-a634-3e0fb5fb22b8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.532030] env[66364]: INFO networking_nsxv3.common.synchronization [req-1192bccb-99c4-4dc4-ba47-52d18f785978 req-33f77c9f-1991-4396-b40d-b7395127fa10 tempest-ServersTestManualDisk-297421654 tempest-ServersTestManualDisk-297421654-project-member] Enqueued Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_members [ 774.532766] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d with Priority: HIGHEST for action security_group_members [ 774.533181] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a59a352e-2737-4849-9aff-a8ce9ffcd13d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.533341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.533427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.533731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.533929] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.534071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.534157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.534363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.534481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.534602] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a59a352e-2737-4849-9aff-a8ce9ffcd13d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.593500] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.608538] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.611996] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.843799] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: SUCCESS [ 774.843799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.843799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.843799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.843799] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.843799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.843799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.843799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.843799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.844860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.844860] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.037605] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.037723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.037827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.038142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.039034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.039034] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.039034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.039034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.039034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.039034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.039034] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d is going to be updated. [ 775.066343] env[66364]: INFO networking_nsxv3.common.synchronization [req-49b86b1f-8451-47e9-8c9c-461fba49add9 req-2d6713dc-3d81-4993-930f-bb004603803a tempest-SecurityGroupRulesTestJSON-1991974859 tempest-SecurityGroupRulesTestJSON-1991974859-project-member] Enqueued Resource ID: 6d3aacfd-b042-49be-8924-5503b26f252c with Priority: HIGHEST for action security_group_rules [ 775.066507] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3aacfd-b042-49be-8924-5503b26f252c with Priority: HIGHEST for action security_group_rules [ 775.067353] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3aacfd-b042-49be-8924-5503b26f252c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.067419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.067455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.067668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.067766] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3aacfd-b042-49be-8924-5503b26f252c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.074100] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.074242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.074334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.074582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.076277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.089493] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d in Status: IN_PROGRESS for 2s [ 775.097290] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.110267] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.114931] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.130725] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: SUCCESS [ 775.130725] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 deletion is rescheduled due to dependency. [ 775.130865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.212256] env[66364]: INFO networking_nsxv3.common.synchronization [req-73144f46-6aa2-4142-ae6f-1bae432de696 req-304ad2e0-088a-4263-a02f-1d767a18758e service nova] Enqueued Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_rules [ 775.212256] env[66364]: INFO networking_nsxv3.common.synchronization [req-73144f46-6aa2-4142-ae6f-1bae432de696 req-304ad2e0-088a-4263-a02f-1d767a18758e service nova] Enqueued Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_members [ 775.212256] env[66364]: INFO networking_nsxv3.common.synchronization [req-73144f46-6aa2-4142-ae6f-1bae432de696 req-304ad2e0-088a-4263-a02f-1d767a18758e service nova] Enqueued Resource ID: 2170eccf-920d-4495-a634-3e0fb5fb22b8 with Priority: HIGHEST for action port [ 775.212256] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_rules [ 775.212256] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_members [ 775.212256] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2170eccf-920d-4495-a634-3e0fb5fb22b8 with Priority: HIGHEST for action port [ 775.212256] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.212256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.212256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.217172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.217172] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.217442] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.217569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.217631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.217818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.217965] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.218073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.218153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.218257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.218348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.218439] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.219251] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-2170eccf-920d-4495-a634-3e0fb5fb22b8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.219401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2170eccf-920d-4495-a634-3e0fb5fb22b8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.219401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2170eccf-920d-4495-a634-3e0fb5fb22b8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.219542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2170eccf-920d-4495-a634-3e0fb5fb22b8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.219624] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2170eccf-920d-4495-a634-3e0fb5fb22b8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.261734] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce5e068-6071-492c-83e7-d1b6b7551653 in Status: SUCCESS [ 775.261734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce5e068-6071-492c-83e7-d1b6b7551653" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.347664] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.347883] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.347923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.348212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.348415] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.348528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.348580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.349438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.349438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.349438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.349438] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.349438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.349438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.349438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.349953] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.349953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.349953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.349953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.349953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.349953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.350260] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.594200] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.594200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.594200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.594200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.594200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.594200] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3aacfd-b042-49be-8924-5503b26f252c already deleted. [ 775.594200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.599093] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.599334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.599444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.599734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.600399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.600399] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 is going to be updated. [ 775.616544] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.616763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.616827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.617056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.617162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.617250] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 is going to be updated. [ 775.618942] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.618942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.618942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.618942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.619167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.619198] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 775.637996] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.638196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.638385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.639109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.639109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.657100] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 in Status: IN_PROGRESS for 2s [ 775.675028] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.675028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.675028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.675028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.675252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.677318] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.677477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.677547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.677735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.678690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.693526] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 775.695653] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: IN_PROGRESS for 2s [ 775.722491] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.722681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.724110] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.725996] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2170eccf-920d-4495-a634-3e0fb5fb22b8 with status ACTIVE [ 775.726636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.726636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.726636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.726850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.726850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.727014] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.727403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.727403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.727403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.727549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.727646] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.728331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.728425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.728569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.728655] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.729643] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2170eccf-920d-4495-a634-3e0fb5fb22b8 is going to be updated. [ 775.759927] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.760237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.760237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.760461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.760645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.760861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2170eccf-920d-4495-a634-3e0fb5fb22b8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.852891] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00f488e0-b3c6-4d70-9a6d-d812a7003523: rpc.has_security_group_logging(os_id): False [ 775.872316] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.872472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.872597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.872845] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.873058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.873147] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.873247] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.873300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.873560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.873658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.873861] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.874017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.874160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.874551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.874857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.874857] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.875061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.875061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.875123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.875191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.875280] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 is going to be updated. [ 775.948133] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.949239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.949344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.949572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.949889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.962032] env[66364]: INFO networking_nsxv3.common.synchronization [req-d971542d-ab64-4905-9435-87832b24b5e6 req-2618a3ac-3135-4095-822c-de2f47b8857c tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 775.962032] env[66364]: INFO networking_nsxv3.common.synchronization [req-d971542d-ab64-4905-9435-87832b24b5e6 req-2618a3ac-3135-4095-822c-de2f47b8857c tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 with Priority: HIGHEST for action security_group_members [ 775.962163] env[66364]: INFO networking_nsxv3.common.synchronization [req-d971542d-ab64-4905-9435-87832b24b5e6 req-2618a3ac-3135-4095-822c-de2f47b8857c tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 775.963228] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: IN_PROGRESS for 2s [ 775.964016] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 775.964016] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 with Priority: HIGHEST for action security_group_members [ 775.964016] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGHEST for action security_group_members [ 775.965767] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.965767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.965767] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5844c9d-c196-40e8-9a43-e89d1e60d237 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.965767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.965767] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.965767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.078251] env[66364]: INFO networking_nsxv3.common.synchronization [req-29158845-b79a-4340-a1e9-3fda3f66716e req-24b097ba-4d2a-4c58-9a88-5561ee47bfef tempest-ImagesNegativeTestJSON-327020873 tempest-ImagesNegativeTestJSON-327020873-project-member] Enqueued Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGHEST for action security_group_members [ 776.078789] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGHEST for action security_group_members [ 776.079086] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.080194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.080194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.080194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.080194] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.080194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.080194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.080194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.080194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.080450] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0832a89a-abcf-4b2f-a153-b9b8672d1e5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.227066] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.313100] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abd2e240-52bb-4f71-913f-ee703bf06524 in Status: SUCCESS [ 776.313100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.313100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.313100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.313100] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.313100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.313534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.313534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.313534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.313534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.313669] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abd2e240-52bb-4f71-913f-ee703bf06524',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.545438] env[66364]: INFO networking_nsxv3.common.synchronization [req-8fc3c6ee-6057-4e3e-8d7d-524c446e39a6 req-955fddfb-2174-4ac5-b8ad-8fdeef2c43df tempest-SecurityGroupRulesTestJSON-1991974859 tempest-SecurityGroupRulesTestJSON-1991974859-project-member] Enqueued Resource ID: 6d3aacfd-b042-49be-8924-5503b26f252c with Priority: HIGHEST for action security_group_rules [ 776.545984] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3aacfd-b042-49be-8924-5503b26f252c with Priority: HIGHEST for action security_group_rules [ 776.546256] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3aacfd-b042-49be-8924-5503b26f252c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.546384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.546461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.546635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.546715] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3aacfd-b042-49be-8924-5503b26f252c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.584708] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.584708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.584708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.584708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.584708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.584708] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.584708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.584708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.584708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.584708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.584708] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d is going to be updated. [ 776.613855] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.614068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.614068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.614290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.614429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.644341] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d in Status: IN_PROGRESS for 2s [ 776.729123] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.729332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.729375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.729584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.729707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.729802] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 is going to be created. [ 776.756546] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.756719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.756719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.759016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.759016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.767272] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 in Status: UNINITIALIZED for 2s [ 776.817663] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd2e240-52bb-4f71-913f-ee703bf06524 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.817921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.817921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.818108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.818281] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.818373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.818433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.818589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.818674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.818770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.818921] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd2e240-52bb-4f71-913f-ee703bf06524 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.818996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.819070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.819214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.819403] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.819512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.819512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.819617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.819723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.819764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.819848] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abd2e240-52bb-4f71-913f-ee703bf06524',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.066818] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.067182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.067182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.067249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.067333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.067464] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3aacfd-b042-49be-8924-5503b26f252c already deleted. [ 777.067555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3aacfd-b042-49be-8924-5503b26f252c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.099406] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d in Status: SUCCESS [ 777.100532] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a59a352e-2737-4849-9aff-a8ce9ffcd13d deletion is rescheduled due to dependency. [ 777.100532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a59a352e-2737-4849-9aff-a8ce9ffcd13d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.224891] env[66364]: INFO networking_nsxv3.common.synchronization [req-0728d594-524a-468f-84f3-91af5244090c req-518ebdbe-e18a-4213-accd-7d597ee4eed4 tempest-ImagesOneServerNegativeTestJSON-519635427 tempest-ImagesOneServerNegativeTestJSON-519635427-project-member] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 777.225706] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 777.226099] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.226274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.226429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.226704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.226953] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.227210] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.227329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.227568] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.227732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.227944] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.322681] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abd2e240-52bb-4f71-913f-ee703bf06524: rpc.has_security_group_logging(os_id): False [ 777.350524] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.350846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.350846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.351093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.351189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.351447] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.352038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.352038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.352038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.352038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.352318] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.352318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.352318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.352427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.352461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.352760] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.352867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.352950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.353138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.353259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.353370] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abd2e240-52bb-4f71-913f-ee703bf06524 is going to be created. [ 777.423876] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.424079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.424079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.424332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.424491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.441492] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abd2e240-52bb-4f71-913f-ee703bf06524 in Status: IN_PROGRESS for 2s [ 777.639092] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.639293] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.639398] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.639652] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.640273] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.640273] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.640273] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.640473] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.640514] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.640722] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.640834] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.640937] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.641127] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.641237] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.641338] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.641465] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.660973] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.661148] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.661278] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.661472] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.661801] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.661969] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.662098] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.662409] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.662546] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.667891] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 in Status: SUCCESS [ 777.668121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.668270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.668471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.668654] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.668767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.668835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.669152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.669152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.669152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.669348] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.670027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.670591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.670591] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.670591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.670591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.670790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.670790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.670853] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.706463] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 777.706730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.707470] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: SUCCESS [ 777.707633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.707780] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.707978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.708172] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.708283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.708343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.708508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.708585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.708669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.708760] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.709525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.709897] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.709897] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.710032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.710032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.710152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.710227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.710306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.710390] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.711944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.711944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.711944] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.711944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.711944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.712133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.712133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.712188] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.712762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.712983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.713176] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.713176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.713278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.713358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.713833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.713833] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.731529] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.732615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.732615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.732615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.732615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.732615] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.732615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.732615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.732615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.732615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.732615] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be updated. [ 777.763241] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.763390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.763390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.763979] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.763979] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.773040] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 777.976973] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: SUCCESS [ 777.977213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.166024] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.166024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.166024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.166024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.166024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.166024] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7 not found, creating... [ 778.166024] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.166024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.166772] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.167169] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.167468] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.169905] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.169905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.169905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.169905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.169905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.169905] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7 is going to be created. [ 778.175019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5844c9d-c196-40e8-9a43-e89d1e60d237',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.175019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.175019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.175019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.175019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.175019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.175019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.175019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.175019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.175019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.175019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.175019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 is going to be deleted. [ 778.198119] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.198356] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.198454] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.198740] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.199031] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.199274] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.212240] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.212398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.214851] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.215833] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.216654] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.216781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.216930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.217070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.217183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.218409] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.218546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.218591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.218796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.218886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.218976] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 is going to be updated. [ 778.220858] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.221438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.221565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.222151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.222259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.222481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.268141] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.268141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.268307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.268987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.268987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.286714] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: IN_PROGRESS for 2s [ 778.655276] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d in Status: SUCCESS [ 778.655451] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d deletion is rescheduled due to dependency. [ 778.655569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.676883] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5844c9d-c196-40e8-9a43-e89d1e60d237: rpc.has_security_group_logging(os_id): False [ 778.695446] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.695446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.695609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.696769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.696769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.696769] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.696769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.696769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.696769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.696769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.696769] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 is going to be created. [ 778.715144] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/b5844c9d-c196-40e8-9a43-e89d1e60d237], does not exist path=[/infra/domains/default/groups/b5844c9d-c196-40e8-9a43-e89d1e60d237]."\n}' [ 778.715409] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b5844c9d-c196-40e8-9a43-e89d1e60d237 [ 778.715409] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 778.721028] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.724132] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63a02b41-2b51-4fad-96f6-6707b3bc8ff7: rpc.has_security_group_logging(os_id): False [ 778.743264] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.743264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.743264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.743264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.743264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.743264] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.743264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.743264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.743264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.743264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.743264] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 is going to be updated. [ 778.751986] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.752147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.752213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.752412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.753669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.753975] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.754107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.754175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.754426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.754426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.754665] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.754763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.754763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.754986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.755165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.755268] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5844c9d-c196-40e8-9a43-e89d1e60d237 is going to be created. [ 778.775343] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/b5844c9d-c196-40e8-9a43-e89d1e60d237], does not exist path=[/infra/domains/default/groups/b5844c9d-c196-40e8-9a43-e89d1e60d237]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b5844c9d-c196-40e8-9a43-e89d1e60d237 [ 778.775514] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5844c9d-c196-40e8-9a43-e89d1e60d237" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.775979] env[66364]: Traceback (most recent call last): [ 778.776057] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 778.776057] env[66364]: return func(*args, **kwargs) [ 778.776057] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 778.776057] env[66364]: res.raise_for_status() [ 778.776057] env[66364]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 778.776057] env[66364]: raise HTTPError(http_error_msg, response=self) [ 778.776057] env[66364]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b5844c9d-c196-40e8-9a43-e89d1e60d237 [ 778.776057] env[66364]: During handling of the above exception, another exception occurred: [ 778.776057] env[66364]: Traceback (most recent call last): [ 778.776057] env[66364]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 778.776057] env[66364]: listener.cb(fileno) [ 778.776057] env[66364]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 778.776057] env[66364]: result = function(*args, **kwargs) [ 778.776057] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 778.776057] env[66364]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 778.776057] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 778.776057] env[66364]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 778.776057] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 778.776057] env[66364]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 778.776057] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 778.776057] env[66364]: res.raise_for_status() [ 778.776057] env[66364]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 778.776057] env[66364]: raise HTTPError(http_error_msg, response=self) [ 778.776057] env[66364]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/b5844c9d-c196-40e8-9a43-e89d1e60d237 [ 778.776057] env[66364]: Removing descriptor: 27 [ 778.776802] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 in Status: SUCCESS [ 778.777016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.777098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.777293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.777478] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.777561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.777616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.777759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.777837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.777913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.778042] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.809286] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.809490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.809592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.810090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.810269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.823868] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: IN_PROGRESS for 2s [ 778.934791] env[66364]: INFO networking_nsxv3.common.synchronization [req-0728d594-524a-468f-84f3-91af5244090c req-e9ca2694-588e-4ec8-b6aa-de36154ef211 service nova] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_rules [ 778.934982] env[66364]: INFO networking_nsxv3.common.synchronization [req-0728d594-524a-468f-84f3-91af5244090c req-e9ca2694-588e-4ec8-b6aa-de36154ef211 service nova] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 778.938604] env[66364]: INFO networking_nsxv3.common.synchronization [req-0728d594-524a-468f-84f3-91af5244090c req-e9ca2694-588e-4ec8-b6aa-de36154ef211 service nova] Enqueued Resource ID: f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7 with Priority: HIGHEST for action port [ 778.939268] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_rules [ 778.939413] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 778.939509] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7 with Priority: HIGHEST for action port [ 778.939796] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.939924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.939990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.940207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.940289] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.941191] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.941284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.941471] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.941570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.941623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.941799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.941877] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.223188] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.223532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.223532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.223675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.223755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.223853] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 779.258963] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.258963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.259308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.260571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.260571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.270186] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 779.281324] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.444666] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.444666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.447915] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7 with status ACTIVE [ 779.448169] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.448296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.448365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.449034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.449034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.449227] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.449332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.449393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.449582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.449661] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.449839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.449931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.450014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.450157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.450230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.450313] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7 is going to be updated. [ 779.461141] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abd2e240-52bb-4f71-913f-ee703bf06524 in Status: SUCCESS [ 779.461497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.475756] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.475964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.476046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.476263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.476414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.476571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f34f0e0b-8ae7-4fa1-ab77-697b7dfd32b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.783251] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c50ff812-f9eb-4476-8c5b-45d3cc1a4532: rpc.has_security_group_logging(os_id): False [ 779.788134] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 779.788134] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f deletion is rescheduled due to dependency. [ 779.788134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.788134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.788415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.788631] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.788825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.788911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.789142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.789273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.789411] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.805823] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.805961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.806035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.806255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.806366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.806581] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.806687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.806747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.806880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.806969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.807071] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 is going to be created. [ 779.884752] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.884752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.884752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.884752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.884752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.901713] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 in Status: IN_PROGRESS for 2s [ 780.292033] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.317625] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: SUCCESS [ 780.317850] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 deletion is rescheduled due to dependency. [ 780.317979] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.794332] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.840333] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 in Status: SUCCESS [ 780.840333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.286749] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 781.287054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.287286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.287538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.287765] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.287933] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.288000] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.288282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.288346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.288401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.288587] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.288712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.288777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.292555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.292555] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.292555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.292555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.292555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.292555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.292555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.292555] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.299645] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.299645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.299645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.299645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.299645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.299645] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be updated. [ 781.334088] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.334088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.334088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.334088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.334088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.346410] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 781.794554] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0ef17dd-12b4-4751-91bb-321b509b882e: rpc.has_security_group_logging(os_id): False [ 781.814705] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.814946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.814998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.815212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.838013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.838013] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.838013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.838013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.838013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.838013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.838013] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.838013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.838013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.838013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.838013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.838451] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.838451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.838451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.838451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.838606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.838638] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 781.905462] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.905462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.905462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.905462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.905462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.927753] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 in Status: SUCCESS [ 781.927753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.931286] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 782.931620] env[66364]: INFO networking_nsxv3.common.synchronization [req-269f8391-405a-412b-9e88-0ad2ea0cc5ce req-e36d2917-ba42-4f92-b7cb-2d21a8ede85b tempest-ServersNegativeTestMultiTenantJSON-1417282816 tempest-ServersNegativeTestMultiTenantJSON-1417282816-project-member] Enqueued Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGHEST for action security_group_members [ 782.932628] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGHEST for action security_group_members [ 782.933581] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.933581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.933581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.933581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.933581] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.933913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.933913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.933913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.933999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.934169] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.364993] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 783.364993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.364993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.365188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.365562] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.365562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.365712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.365911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.367358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.367358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.367358] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.431278] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.431555] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-678" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.431695] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-678" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.432497] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-678" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.432880] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.433113] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.433235] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.433510] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.433763] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.434104] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.434104] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.434212] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.434406] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.434453] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.434551] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.434678] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.437064] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.437186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.437578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.437756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.437836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.438094] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.438197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.438520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.438620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.438766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.438810] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 already deleted. [ 783.438897] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.461105] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.461275] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.461406] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.461577] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-678" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.462221] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-b4b4ea50-0c07-443b-97e6-968fde95b855 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.462221] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-b4b4ea50-0c07-443b-97e6-968fde95b855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.462221] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-b4b4ea50-0c07-443b-97e6-968fde95b855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.462741] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-b4b4ea50-0c07-443b-97e6-968fde95b855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.462941] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b4ea50-0c07-443b-97e6-968fde95b855',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.872491] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.872694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.872833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.873076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.873260] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.873365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.873429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.873631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.873691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.873787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.873934] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.874039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.874100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.874244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.874385] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.874470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.874528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.874664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.874751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.874815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.874902] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.951340] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 783.951752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.965776] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.966016] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.966148] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.966447] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.966613] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.966766] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port b4b4ea50-0c07-443b-97e6-968fde95b855 not found, creating... [ 783.967054] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.967215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.967326] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.967547] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.967688] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.968057] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.968228] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.968350] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.968584] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.968775] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.968870] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: b4b4ea50-0c07-443b-97e6-968fde95b855 is going to be created. [ 783.990132] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.990386] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.990494] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.990811] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.991045] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.991290] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-b4b4ea50-0c07-443b-97e6-968fde95b855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.379787] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 296f3936-dac0-44a8-a46a-d39ee062c69f: rpc.has_security_group_logging(os_id): False [ 784.398694] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.398694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.398694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.398694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.418775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.419531] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.419531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.419531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.419531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.419889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.419889] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.420223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.420223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.420312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.420312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.420547] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.420681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.420681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.420784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.420856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.420938] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be updated. [ 784.494017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.494017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.494017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.494017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.494017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.514444] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 784.726693] env[66364]: INFO networking_nsxv3.common.synchronization [req-269f8391-405a-412b-9e88-0ad2ea0cc5ce req-aec2db53-078a-454b-8574-419ea967a929 service nova] Enqueued Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGHEST for action security_group_rules [ 784.726824] env[66364]: INFO networking_nsxv3.common.synchronization [req-269f8391-405a-412b-9e88-0ad2ea0cc5ce req-aec2db53-078a-454b-8574-419ea967a929 service nova] Enqueued Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGHEST for action security_group_members [ 784.726991] env[66364]: INFO networking_nsxv3.common.synchronization [req-269f8391-405a-412b-9e88-0ad2ea0cc5ce req-aec2db53-078a-454b-8574-419ea967a929 service nova] Enqueued Resource ID: b4b4ea50-0c07-443b-97e6-968fde95b855 with Priority: HIGHEST for action port [ 784.728188] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGHEST for action security_group_rules [ 784.728188] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGHEST for action security_group_members [ 784.728188] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4b4ea50-0c07-443b-97e6-968fde95b855 with Priority: HIGHEST for action port [ 784.728188] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.728539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.728539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.728603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.728784] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.731406] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.731538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.731654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.731871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.732066] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.732223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.734847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.734847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.734847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.734847] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.735367] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4b4ea50-0c07-443b-97e6-968fde95b855 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.735367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4b4ea50-0c07-443b-97e6-968fde95b855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.735367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4b4ea50-0c07-443b-97e6-968fde95b855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.735492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4b4ea50-0c07-443b-97e6-968fde95b855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.735655] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b4ea50-0c07-443b-97e6-968fde95b855',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.237432] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.237844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.237844] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.238894] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4b4ea50-0c07-443b-97e6-968fde95b855 with status ACTIVE [ 785.238996] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.239116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.239183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.239398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.239484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.239669] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.239756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.239821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.240115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.240406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.240499] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.241196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.241196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.241196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.241196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.241196] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4b4ea50-0c07-443b-97e6-968fde95b855 is going to be updated. [ 785.271915] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.271915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.271915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.271915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.271915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.271915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4b4ea50-0c07-443b-97e6-968fde95b855" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.743210] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.246509] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.246880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.246880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.247183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.247523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.247523] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 is going to be created. [ 786.272038] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.272205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.272714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.272714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.272714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.284080] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 in Status: UNINITIALIZED for 2s [ 786.535704] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 786.536089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.817808] env[66364]: INFO networking_nsxv3.common.synchronization [req-025edd84-88cb-4159-b764-ced26f61779c req-acdc6d4a-0ae2-451b-bd79-7aa314c46c87 tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 787.818383] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 787.818691] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.818810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.819086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.819258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.819434] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.819550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.819662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.819772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.819860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.819956] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.300463] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 in Status: SUCCESS [ 788.300463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.302407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.302407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.302407] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.302407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.302407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.302407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.302407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.303067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.303067] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.323407] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.324200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.324200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.324200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.357754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.358046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.358046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.358046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.358300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.358347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.358543] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 788.391779] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.391921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.391975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.392304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.392465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.409818] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 788.464966] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-501 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.465103] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.465167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.465429] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.468851] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.468851] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.468851] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.468851] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.468851] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.468851] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.468851] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.468851] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.468851] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.468851] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.468851] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.468851] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.494324] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.494507] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.494641] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.494839] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.495250] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-3523c1cf-9714-46d9-b175-cef060496b88 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.495439] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-3523c1cf-9714-46d9-b175-cef060496b88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.495597] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-3523c1cf-9714-46d9-b175-cef060496b88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.495892] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-3523c1cf-9714-46d9-b175-cef060496b88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.496047] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3523c1cf-9714-46d9-b175-cef060496b88',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.768685] env[66364]: INFO networking_nsxv3.common.synchronization [None req-45383936-8ad8-4353-bc58-cbbe2b394ecc None None] Enqueued Resource ID: c19874d0-0aa3-4233-8e7d-1854270b347a with Priority: HIGHEST for action port [ 788.769695] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c19874d0-0aa3-4233-8e7d-1854270b347a with Priority: HIGHEST for action port [ 788.769695] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c19874d0-0aa3-4233-8e7d-1854270b347a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.769887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c19874d0-0aa3-4233-8e7d-1854270b347a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.769887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c19874d0-0aa3-4233-8e7d-1854270b347a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.770084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c19874d0-0aa3-4233-8e7d-1854270b347a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.770210] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c19874d0-0aa3-4233-8e7d-1854270b347a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.805427] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.805593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.805664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.806818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.807087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.807505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.807505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.807505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.807656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.807742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.807925] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.808046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.808109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.808282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.808484] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.808621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.808681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.808857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.808977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.809100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.809207] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.999959] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.000258] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.000343] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.000815] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.000815] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.000924] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 3523c1cf-9714-46d9-b175-cef060496b88 not found, creating... [ 789.001138] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.001288] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.001396] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.001604] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.001734] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.002014] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.002165] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.002274] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.002470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.002593] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.002757] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 3523c1cf-9714-46d9-b175-cef060496b88 is going to be created. [ 789.024732] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.025072] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.025276] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.025699] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.026118] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.026476] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-3523c1cf-9714-46d9-b175-cef060496b88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.272218] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c19874d0-0aa3-4233-8e7d-1854270b347a [ 789.272463] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.272598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.272750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.272987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.273092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.273189] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c19874d0-0aa3-4233-8e7d-1854270b347a already deleted. [ 789.273281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c19874d0-0aa3-4233-8e7d-1854270b347a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.312982] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ae9b572-f2b7-43ae-9076-285c394304b7: rpc.has_security_group_logging(os_id): False [ 789.337410] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.337410] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.337410] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.337410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.338193] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.338414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.338507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.338704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.338790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.338910] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 is going to be created. [ 789.409320] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.409540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.409540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.410193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.410193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.427819] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 in Status: IN_PROGRESS for 2s [ 789.757311] env[66364]: INFO networking_nsxv3.common.synchronization [req-025edd84-88cb-4159-b764-ced26f61779c req-4725dcce-937b-4840-8c90-cde77acbaab6 service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 789.757483] env[66364]: INFO networking_nsxv3.common.synchronization [req-025edd84-88cb-4159-b764-ced26f61779c req-4725dcce-937b-4840-8c90-cde77acbaab6 service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 789.757615] env[66364]: INFO networking_nsxv3.common.synchronization [req-025edd84-88cb-4159-b764-ced26f61779c req-4725dcce-937b-4840-8c90-cde77acbaab6 service nova] Enqueued Resource ID: 3523c1cf-9714-46d9-b175-cef060496b88 with Priority: HIGHEST for action port [ 789.758165] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 789.758384] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 789.758384] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3523c1cf-9714-46d9-b175-cef060496b88 with Priority: HIGHEST for action port [ 789.758924] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.758924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.758924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.759254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.759254] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.761218] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.761218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.762466] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-3523c1cf-9714-46d9-b175-cef060496b88 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.762466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3523c1cf-9714-46d9-b175-cef060496b88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.762466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3523c1cf-9714-46d9-b175-cef060496b88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.762466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3523c1cf-9714-46d9-b175-cef060496b88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.762466] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3523c1cf-9714-46d9-b175-cef060496b88',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.990337] env[66364]: INFO networking_nsxv3.common.synchronization [req-4b1eccc4-14b2-4023-9ac3-541e49eed1f1 req-5291b5a1-6d0b-4587-9b93-72259bda0a5d tempest-InstanceActionsV221TestJSON-1268642956 tempest-InstanceActionsV221TestJSON-1268642956-project-member] Enqueued Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGHEST for action security_group_members [ 789.990905] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGHEST for action security_group_members [ 789.991212] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-abd2e240-52bb-4f71-913f-ee703bf06524 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.991332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.991402] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.991603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.991755] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.991852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.991912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.992200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.992200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.992360] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abd2e240-52bb-4f71-913f-ee703bf06524',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.261857] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.262217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.265038] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3523c1cf-9714-46d9-b175-cef060496b88 with status ACTIVE [ 790.265336] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.265544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.265660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.266660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.266660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.266660] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.266660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.266660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.266929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.266929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.267731] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.267731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.267731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.267731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.269753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.271876] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3523c1cf-9714-46d9-b175-cef060496b88 is going to be updated. [ 790.320817] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.320971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.321133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.321782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.321782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.321782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3523c1cf-9714-46d9-b175-cef060496b88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.334553] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.334793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.334793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.335120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.335256] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.431031] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 790.431031] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 deletion is rescheduled due to dependency. [ 790.431031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.431031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.431031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.431031] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.431031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.431031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.431031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.431031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.432042] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.498291] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.498291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.498291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.498291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.522958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.523240] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.523359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.523415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.523618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.523705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.523793] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abd2e240-52bb-4f71-913f-ee703bf06524 is going to be updated. [ 790.562085] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.562238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.562311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.562530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.562868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.574209] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abd2e240-52bb-4f71-913f-ee703bf06524 in Status: IN_PROGRESS for 2s [ 790.758130] env[66364]: INFO networking_nsxv3.common.synchronization [req-06a864fb-14f5-4e37-af40-0fa3c39e5342 req-a918946a-3400-4bc4-92ca-5b57c1cb60a7 tempest-ServersAdminNegativeTestJSON-1819478050 tempest-ServersAdminNegativeTestJSON-1819478050-project-member] Enqueued Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 790.758740] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 790.759087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.759193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.759193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.759560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.759560] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.759648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.759874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.759874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.760030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.762253] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.816963] env[66364]: INFO networking_nsxv3.common.synchronization [None req-6071d02a-b86f-4f13-adc4-440bafc8ea73 None None] Enqueued Resource ID: 0386569f-d32c-4ef3-aef1-07ed3b0eddf5 with Priority: HIGHEST for action port [ 790.819019] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0386569f-d32c-4ef3-aef1-07ed3b0eddf5 with Priority: HIGHEST for action port [ 790.819019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0386569f-d32c-4ef3-aef1-07ed3b0eddf5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.819019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0386569f-d32c-4ef3-aef1-07ed3b0eddf5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.819019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0386569f-d32c-4ef3-aef1-07ed3b0eddf5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.819019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0386569f-d32c-4ef3-aef1-07ed3b0eddf5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.819019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0386569f-d32c-4ef3-aef1-07ed3b0eddf5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.840159] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.864751] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b20a2e59-b837-462f-9ff7-7c5805f56366 None None] Enqueued Resource ID: 7dc293b2-0756-458a-8cf3-5f8b8408f803 with Priority: HIGHEST for action port [ 790.865608] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dc293b2-0756-458a-8cf3-5f8b8408f803 with Priority: HIGHEST for action port [ 790.865927] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dc293b2-0756-458a-8cf3-5f8b8408f803 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.868537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dc293b2-0756-458a-8cf3-5f8b8408f803" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.868719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dc293b2-0756-458a-8cf3-5f8b8408f803" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.869229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dc293b2-0756-458a-8cf3-5f8b8408f803" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.869229] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dc293b2-0756-458a-8cf3-5f8b8408f803',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.936037] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.147913] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.148138] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.148260] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.148518] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.148780] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.149479] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.149612] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.149906] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.150060] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.150413] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.150529] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.150701] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.150811] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.150910] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.151020] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.151155] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.172774] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.172774] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 791.172774] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.172774] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.173061] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-383eea1b-d263-459c-9083-6bc03377c609 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.173267] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-383eea1b-d263-459c-9083-6bc03377c609" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.173378] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-383eea1b-d263-459c-9083-6bc03377c609" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.173780] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-383eea1b-d263-459c-9083-6bc03377c609" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.173962] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383eea1b-d263-459c-9083-6bc03377c609',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.266102] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.321310] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0386569f-d32c-4ef3-aef1-07ed3b0eddf5 [ 791.321540] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.321691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.321806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.321981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.322086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.322181] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0386569f-d32c-4ef3-aef1-07ed3b0eddf5 already deleted. [ 791.322263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0386569f-d32c-4ef3-aef1-07ed3b0eddf5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.343195] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.371126] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7dc293b2-0756-458a-8cf3-5f8b8408f803 [ 791.371275] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.371458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.371515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.371680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.371759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.371854] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7dc293b2-0756-458a-8cf3-5f8b8408f803 already deleted. [ 791.371932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dc293b2-0756-458a-8cf3-5f8b8408f803" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.438373] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.454673] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 in Status: SUCCESS [ 791.455020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.676729] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.678022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.678022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.678022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.678022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.678022] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 383eea1b-d263-459c-9083-6bc03377c609 not found, creating... [ 791.678022] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.678367] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.678367] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.678428] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.678526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.678809] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.678966] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.679080] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.679297] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.679472] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.679545] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 383eea1b-d263-459c-9083-6bc03377c609 is going to be created. [ 791.701783] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.701947] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.702071] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.702306] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.702531] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.702967] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-383eea1b-d263-459c-9083-6bc03377c609" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.768032] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.849676] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 791.849839] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 791.943562] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.943719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.943805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.944085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.944206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.944309] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 791.977880] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.978080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.978145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.978361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.981031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.988444] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 792.272367] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.272367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.272367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.272853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.272853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.272853] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007f96f6-a408-4a76-b5c6-eceae8238916 is going to be updated. [ 792.319679] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.319831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.319894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.320137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.320315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.333488] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: IN_PROGRESS for 2s [ 792.536887] env[66364]: INFO networking_nsxv3.common.synchronization [req-06a864fb-14f5-4e37-af40-0fa3c39e5342 req-d7dd342a-523d-4e1c-87ac-459700e8a3e6 service nova] Enqueued Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_rules [ 792.536887] env[66364]: INFO networking_nsxv3.common.synchronization [req-06a864fb-14f5-4e37-af40-0fa3c39e5342 req-d7dd342a-523d-4e1c-87ac-459700e8a3e6 service nova] Enqueued Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 792.536887] env[66364]: INFO networking_nsxv3.common.synchronization [req-06a864fb-14f5-4e37-af40-0fa3c39e5342 req-d7dd342a-523d-4e1c-87ac-459700e8a3e6 service nova] Enqueued Resource ID: 383eea1b-d263-459c-9083-6bc03377c609 with Priority: HIGHEST for action port [ 792.536887] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_rules [ 792.536887] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 792.536887] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 383eea1b-d263-459c-9083-6bc03377c609 with Priority: HIGHEST for action port [ 792.536887] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.536887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.536887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.536887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.536887] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.537495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.537495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.537495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-383eea1b-d263-459c-9083-6bc03377c609 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.537664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-383eea1b-d263-459c-9083-6bc03377c609" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.537664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-383eea1b-d263-459c-9083-6bc03377c609" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.538749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-383eea1b-d263-459c-9083-6bc03377c609" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.538749] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383eea1b-d263-459c-9083-6bc03377c609',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.593030] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abd2e240-52bb-4f71-913f-ee703bf06524 in Status: SUCCESS [ 792.593030] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abd2e240-52bb-4f71-913f-ee703bf06524 deletion is rescheduled due to dependency. [ 792.593030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.891826] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.892566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.892638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.892991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.906318] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 792.906318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.907012] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 792.938900] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.939067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.939125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.939299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.946704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.946704] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 792.946878] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 792.946878] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 792.985059] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.985244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.985321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.985536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.986372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.986519] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 793.041175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.041353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.041488] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 383eea1b-d263-459c-9083-6bc03377c609 with status ACTIVE [ 793.041652] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.041804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.041891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.042174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.042283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.042463] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.042593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.042633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.042847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.042927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.043119] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.043201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.043268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.043395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.043462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.043544] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 383eea1b-d263-459c-9083-6bc03377c609 is going to be updated. [ 793.071040] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.071040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.071040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.071040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.071040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.071656] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 793.090237] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.090320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.090357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.090765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.090859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.090993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-383eea1b-d263-459c-9083-6bc03377c609" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.232328] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.232328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.232328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.232328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.232328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.232847] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 793.232909] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ad194291-e1d7-48e3-b3d4-5e26a902dc4b', '9b09036d-f422-41d0-af9e-74fbcbfb71a6', '1861e5fb-2be6-4354-a9e1-67fd55022b22', 'ebb41e34-3a6d-4c7e-a19c-48afdcc86d62', '63a02b41-2b51-4fad-96f6-6707b3bc8ff7', 'c000df34-07b2-4015-b824-73615ee8d750', 'a51a2156-9364-4e92-8d3f-5ecb8f11f0f8', '2ae9b572-f2b7-43ae-9076-285c394304b7', '7b57d473-6bcb-4eff-94aa-74472df3d57a', '19e02b7c-5738-40ef-bfaa-0d499061b1d5', 'abd2e240-52bb-4f71-913f-ee703bf06524', 'c9dde915-fa65-4509-8423-f46e62870074', '97a7651b-f7fd-4861-bb60-9879cd8461c2', '00f488e0-b3c6-4d70-9a6d-d812a7003523', 'df21da4b-98ac-4bfa-b751-65483a460873', 'a0ef17dd-12b4-4751-91bb-321b509b882e', '5467face-590a-4281-b5c2-cf02d5a2e65f', '784e3e36-fad9-4cd6-a173-77329b5f03c2', '395cdc70-30b6-4310-922a-3b2324c4a164', '0832a89a-abcf-4b2f-a153-b9b8672d1e5d', '02c59c8a-da67-420a-8de3-ef613658b83d', 'cb447688-9fc5-4154-bc02-69edb9629669', '37506c58-083d-46d9-8010-be6545a2e954', '5165fdef-bf23-471f-87fc-3248cc2d9078', '2ce5e068-6071-492c-83e7-d1b6b7551653', 'c50ff812-f9eb-4476-8c5b-45d3cc1a4532', 'f0345151-3287-4add-b6b3-bbb72460c6bd', '64957bc0-2496-43d3-8cbd-8653bab5f68b', 'bb1358a0-c55b-4cc7-8303-f2d79335b98a', 'a59a352e-2737-4849-9aff-a8ce9ffcd13d', '296f3936-dac0-44a8-a46a-d39ee062c69f', '6b563fa6-e694-4628-a9da-1beb0ee48864', '00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7', '007f96f6-a408-4a76-b5c6-eceae8238916'} {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 793.232984] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 793.265016] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.265016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.265016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.265016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.265016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.265016] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 793.265016] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 793.265016] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 793.368027] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.368027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.368027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.368027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.368027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.370958] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 793.370958] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 793.370958] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 793.370958] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 793.370958] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGH for action security_group_rules [ 793.370958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.859579] env[66364]: INFO networking_nsxv3.common.synchronization [None req-36ded58f-333d-491f-9321-e3ff0d81a547 None None] Enqueued Resource ID: d7169962-9004-4ddd-91f5-9fb941de0542 with Priority: HIGHEST for action port [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7169962-9004-4ddd-91f5-9fb941de0542 with Priority: HIGHEST for action port [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGH for action security_group_rules [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 with Priority: HIGH for action security_group_rules [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 with Priority: HIGH for action security_group_rules [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGH for action security_group_rules [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d with Priority: HIGH for action security_group_rules [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 395cdc70-30b6-4310-922a-3b2324c4a164 with Priority: HIGH for action security_group_rules [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGH for action security_group_rules [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5467face-590a-4281-b5c2-cf02d5a2e65f with Priority: HIGH for action security_group_rules [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGH for action security_group_rules [ 793.860755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGH for action security_group_rules [ 793.861334] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGH for action security_group_rules [ 793.861334] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9dde915-fa65-4509-8423-f46e62870074 with Priority: HIGH for action security_group_rules [ 793.861334] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd2e240-52bb-4f71-913f-ee703bf06524 with Priority: HIGH for action security_group_rules [ 793.861334] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 with Priority: HIGH for action security_group_rules [ 793.861334] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a with Priority: HIGH for action security_group_rules [ 793.861334] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGH for action security_group_rules [ 793.861334] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGH for action security_group_rules [ 793.861534] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 with Priority: HIGH for action security_group_rules [ 793.861534] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 with Priority: HIGH for action security_group_rules [ 793.861594] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGH for action security_group_rules [ 793.864172] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7169962-9004-4ddd-91f5-9fb941de0542 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.864307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7169962-9004-4ddd-91f5-9fb941de0542" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.864376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7169962-9004-4ddd-91f5-9fb941de0542" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.864633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7169962-9004-4ddd-91f5-9fb941de0542" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.864726] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7169962-9004-4ddd-91f5-9fb941de0542',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.865625] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.865748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.865816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.866382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.866382] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.866823] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1861e5fb-2be6-4354-a9e1-67fd55022b22 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.866949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.867011] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.867159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.867224] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1861e5fb-2be6-4354-a9e1-67fd55022b22',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.868493] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.868493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.868493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.868659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.868659] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a51a2156-9364-4e92-8d3f-5ecb8f11f0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.025114] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.025283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.025406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.025555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.025671] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.027167] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.027354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.027354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.028385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.028385] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0832a89a-abcf-4b2f-a153-b9b8672d1e5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.028492] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-395cdc70-30b6-4310-922a-3b2324c4a164 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.030865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.030865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.030865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.030865] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('395cdc70-30b6-4310-922a-3b2324c4a164',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.030865] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.030865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.030865] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5467face-590a-4281-b5c2-cf02d5a2e65f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.030865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.030865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.030865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.030865] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5467face-590a-4281-b5c2-cf02d5a2e65f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.032730] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.032730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.032730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.032730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.032730] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.032730] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.032730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.032730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.033277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.033277] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.034532] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.034532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.034532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.034532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.034532] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.034532] env[66364]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 794.035151] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9dde915-fa65-4509-8423-f46e62870074 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.035259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.035323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.035687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.035687] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9dde915-fa65-4509-8423-f46e62870074',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.036363] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abd2e240-52bb-4f71-913f-ee703bf06524 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.036448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.036508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.036959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.036959] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abd2e240-52bb-4f71-913f-ee703bf06524',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.037630] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.037728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.037788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.038012] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.038012] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19e02b7c-5738-40ef-bfaa-0d499061b1d5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.038867] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b57d473-6bcb-4eff-94aa-74472df3d57a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.038966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.039042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.039189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.039260] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b57d473-6bcb-4eff-94aa-74472df3d57a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.040057] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.040168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.040234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.040383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.040453] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.041373] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.041489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.041537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.041682] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.041749] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.042595] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.042712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.042765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.042898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.042970] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63a02b41-2b51-4fad-96f6-6707b3bc8ff7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.043802] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.043908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.044167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.044167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.044275] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b09036d-f422-41d0-af9e-74fbcbfb71a6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.045136] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.045238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.045302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.045454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.045526] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.070945] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 794.070945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.074495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.074701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.074924] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.075069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.075069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.075241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.075311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.075389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.075475] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.078741] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.079522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.079522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.079522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.107816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.108090] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1861e5fb-2be6-4354-a9e1-67fd55022b22 is going to be deleted. [ 794.174821] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.175869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.176206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.176302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.176347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.176446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1861e5fb-2be6-4354-a9e1-67fd55022b22" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.345812] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: SUCCESS [ 794.345812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.345812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.345812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.345812] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.345812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.345812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.345812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.345812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.345812] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.345812] env[66364]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 794.550276] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.550276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.550634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.550634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.553542] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.553542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.553542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.553542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.553542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.553542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.553542] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.554745] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7169962-9004-4ddd-91f5-9fb941de0542 [ 794.555219] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.555413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.555413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.556034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.556034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.558302] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7169962-9004-4ddd-91f5-9fb941de0542 already deleted. [ 794.558302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7169962-9004-4ddd-91f5-9fb941de0542" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.580800] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.582215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.582475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.582999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.587043] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.587230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.587273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.587450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.587608] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.587704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.587765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.587917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.588128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.588255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.591177] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.591292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.591361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.591540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.591707] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.591805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.591884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.592645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.592827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.592925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.593029] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.600793] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.601042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.601126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.601331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.601543] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.601646] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.601710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.601865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.602013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.602118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.602207] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.606548] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.606548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.606673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.606848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.606919] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.606987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.607076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.607262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.607352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.607433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.607545] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.608563] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.608687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.608784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.609014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.609317] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.609471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.609578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.609787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.609879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.609968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.610068] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.611250] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.611412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.611519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.611752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.611960] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.612117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.612213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.612430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.612555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.612693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.612898] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.617445] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.617771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.617896] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.618541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.618541] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.618655] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.618690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.618959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.619111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.619259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.619517] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.635378] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 784e3e36-fad9-4cd6-a173-77329b5f03c2: rpc.has_security_group_logging(os_id): False [ 794.638469] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.651115] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.651298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.651401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.651708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.651964] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.652158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.652255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.652484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.652605] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.652740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.652855] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.657320] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df21da4b-98ac-4bfa-b751-65483a460873: rpc.has_security_group_logging(os_id): False [ 794.685139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.685315] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a51a2156-9364-4e92-8d3f-5ecb8f11f0f8 is going to be deleted. [ 794.708140] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.708436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.708436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.708880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.710647] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.710647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.711582] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.711774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.729023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.729023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.729023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.729023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.733327] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.734440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.735100] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.735303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.736294] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.736431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.737349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.737530] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5467face-590a-4281-b5c2-cf02d5a2e65f is going to be deleted. [ 794.739662] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.739662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.739662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.739923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.742445] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.742445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.743173] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.743173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.743774] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.743950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.779858] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 794.780554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.780835] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19e02b7c-5738-40ef-bfaa-0d499061b1d5 is going to be deleted. [ 794.782208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.782542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.794917] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.794917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.805654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.805825] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c000df34-07b2-4015-b824-73615ee8d750 is going to be deleted. [ 794.807353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.807603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.832735] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.832964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.834348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.834493] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b09036d-f422-41d0-af9e-74fbcbfb71a6 is going to be deleted. [ 794.835530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.835778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.847775] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.849645] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.849777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.862049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.862445] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b57d473-6bcb-4eff-94aa-74472df3d57a is going to be deleted. [ 794.863354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.863577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.934090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.934299] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 395cdc70-30b6-4310-922a-3b2324c4a164 is going to be deleted. [ 794.936350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.936616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.965577] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.965577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.998111] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.998312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.018826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.019203] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.019379] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.019459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.019719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.019874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.020202] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.020335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.020449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.020693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.020898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.021176] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.021285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.021344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.021512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.021654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.021801] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 795.023205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.023657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.033458] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.033458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.057982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.057982] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0832a89a-abcf-4b2f-a153-b9b8672d1e5d is going to be deleted. [ 795.059163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.059460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.060503] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.115649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.115808] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63a02b41-2b51-4fad-96f6-6707b3bc8ff7 is going to be deleted. [ 795.116830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.117157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.122511] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.122759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.122857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.123035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.123219] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.123327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.123391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.123551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.123645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.123818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.124262] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.124262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.124353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.124547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.124764] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.124901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.125131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.125575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.125724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.125821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.125910] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.135687] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.135918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.135989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.136214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.136420] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.136536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.136582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.136705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.136789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.136876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.137046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.137138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.137192] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.137334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.137471] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.138604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.138604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.138604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.138604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.138604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.138604] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.145961] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.146225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.146306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.146567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.146753] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.146925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.147040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.147260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.147363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.147505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.147750] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.147862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.147930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.148172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.148392] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.148497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.148553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.148760] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.148884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.149024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.149121] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.150718] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.165838] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.166023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.166091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.166345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.166517] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.166645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.166710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.166872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.166972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.167091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.167244] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.167337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.167394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.167632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.167807] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.167950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.168022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.168221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.168348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.168472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.168613] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.197117] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.197363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.212890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.213041] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9dde915-fa65-4509-8423-f46e62870074 is going to be deleted. [ 795.214524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.214835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.232578] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.232844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.246402] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.246570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.268761] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.269059] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.277205] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 795.279334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.279334] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abd2e240-52bb-4f71-913f-ee703bf06524 is going to be deleted. [ 795.280879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.280879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.280879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.280879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a51a2156-9364-4e92-8d3f-5ecb8f11f0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.282024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.282024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.282024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.282024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5467face-590a-4281-b5c2-cf02d5a2e65f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.285377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.285377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.285377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.285377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19e02b7c-5738-40ef-bfaa-0d499061b1d5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.285377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.285377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.285377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.285377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.285377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.285691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.285691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.285756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b09036d-f422-41d0-af9e-74fbcbfb71a6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.285829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.285968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.329067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.329477] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.330014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.330014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.330014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.330014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.330257] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df21da4b-98ac-4bfa-b751-65483a460873 is going to be updated. [ 795.332154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b57d473-6bcb-4eff-94aa-74472df3d57a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-395cdc70-30b6-4310-922a-3b2324c4a164" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.334016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.334763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.334933] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.335033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.335133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0832a89a-abcf-4b2f-a153-b9b8672d1e5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.335737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.335974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.336096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.336280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63a02b41-2b51-4fad-96f6-6707b3bc8ff7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.353286] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.425041] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.425041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.425041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.425041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.425041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.425041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9dde915-fa65-4509-8423-f46e62870074" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.457511] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.458967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.459890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.460637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.460810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.461071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abd2e240-52bb-4f71-913f-ee703bf06524" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.498421] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 795.564436] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad194291-e1d7-48e3-b3d4-5e26a902dc4b: rpc.has_security_group_logging(os_id): False [ 795.598967] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.598967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.599121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.599285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.601125] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.601243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.628253] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0ef17dd-12b4-4751-91bb-321b509b882e: rpc.has_security_group_logging(os_id): False [ 795.640187] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ebb41e34-3a6d-4c7e-a19c-48afdcc86d62: rpc.has_security_group_logging(os_id): False [ 795.651482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.651482] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.651482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.651482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.651482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.651482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.651482] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be updated. [ 795.653032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.653139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.653329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.654667] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00f488e0-b3c6-4d70-9a6d-d812a7003523: rpc.has_security_group_logging(os_id): False [ 795.655443] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 97a7651b-f7fd-4861-bb60-9879cd8461c2: rpc.has_security_group_logging(os_id): False [ 795.670757] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ae9b572-f2b7-43ae-9076-285c394304b7: rpc.has_security_group_logging(os_id): False [ 795.687696] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.687901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.687901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.688156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.706732] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.706939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.716765] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.716765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.716765] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.717100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.737300] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.737663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.740710] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: IN_PROGRESS for 2s [ 795.753235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.753235] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.753235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.753235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.753235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.753235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.753235] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.753235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.753235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.753235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.754047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.754047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.754047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.754047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.754189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.754226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.754391] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 795.755538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.756055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.790918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.791914] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.791914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.791914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.791914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.792199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.792199] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 is going to be updated. [ 795.793527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.793752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.807880] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.807967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.824353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.824633] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.824748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.824976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.825093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.825181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.825402] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.825504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.825564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.825714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.825792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.826008] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.826095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.826173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.826290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.826358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.826452] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 795.827685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.827888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.854264] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.854416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.855321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.855816] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.855816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.855816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.855989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.856046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.858430] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.858684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.858684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.859080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.859168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.859457] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.859543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.859580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.859793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.859891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.859992] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 is going to be updated. [ 795.861144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.861315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.861457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.862667] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.862821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.862903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.863009] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.863099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.863201] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007f96f6-a408-4a76-b5c6-eceae8238916 is going to be updated. [ 795.864415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.864415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.903373] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.903518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.915772] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: IN_PROGRESS for 2s [ 795.932406] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.932566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.932645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.933041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.933226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.939762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.941421] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.941421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.941421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.941421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.941421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.941421] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.941421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.941421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.941805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.941805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.942058] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.942205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.942318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.942574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.942706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.942933] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 is going to be updated. [ 795.944373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.944572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.944765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.946062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.946159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.946342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.951345] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: IN_PROGRESS for 2s [ 796.027921] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 in Status: IN_PROGRESS for 2s [ 796.033778] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 796.094329] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.094329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.094549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.094582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.094855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.101728] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.101890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.101969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.102216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.102363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.144678] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.144965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.145147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.145395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.145553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.149159] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: IN_PROGRESS for 2s [ 796.149863] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 796.183477] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 796.183649] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 in Status: IN_PROGRESS for 2s [ 797.515482] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 797.515754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.515797] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.516135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.516283] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.763093] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: SUCCESS [ 797.763093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.932382] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: SUCCESS [ 797.932645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.962056] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: SUCCESS [ 797.962056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.962056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.962212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.962610] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.962610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.962610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.962806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.962806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.962899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.962986] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.019285] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.019544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.019544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.019963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.020217] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.020315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.020366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.020525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.020608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.020694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.020911] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.045131] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 in Status: SUCCESS [ 798.045367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.056455] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 798.056875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.092268] env[66364]: INFO networking_nsxv3.common.synchronization [None req-2038cdc5-985a-41ed-a232-4c8ccb75d4c3 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_rules [ 798.092268] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_rules [ 798.092596] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-665d57cc-5dea-494f-b1df-651330cfd64a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.092692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.092785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.093404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.093490] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.171026] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: SUCCESS [ 798.171026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.178818] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 798.178818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.204425] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 in Status: SUCCESS [ 798.204425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.267697] env[66364]: INFO networking_nsxv3.common.synchronization [None req-bd82e09b-7c16-4add-9f88-d90b6c48ae8a tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_rules [ 798.268825] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_rules [ 798.269424] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-665d57cc-5dea-494f-b1df-651330cfd64a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.269623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.406721] env[66364]: INFO networking_nsxv3.common.synchronization [None req-6c5fa15d-3970-4b96-b46b-9444dde7d68d None None] Enqueued Resource ID: 8e8dbf2f-ae7a-484d-a8db-2aca79ca1820 with Priority: HIGHEST for action port [ 798.407582] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8dbf2f-ae7a-484d-a8db-2aca79ca1820 with Priority: HIGHEST for action port [ 798.408122] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e8dbf2f-ae7a-484d-a8db-2aca79ca1820 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.408411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e8dbf2f-ae7a-484d-a8db-2aca79ca1820" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.408411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e8dbf2f-ae7a-484d-a8db-2aca79ca1820" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.408801] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e8dbf2f-ae7a-484d-a8db-2aca79ca1820" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.408890] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e8dbf2f-ae7a-484d-a8db-2aca79ca1820',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.469604] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.469604] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.469604] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.469604] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.469604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.470895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.470895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.470895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.470895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.470895] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.523635] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.524214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.524214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.524320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.524569] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.524713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.524774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.524944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.525060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.525190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.525567] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.525567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.525567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.525736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.525801] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.525903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.526018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.526221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.526306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.527030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.527260] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.616668] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.619024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.619024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.619024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.619024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.619024] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 665d57cc-5dea-494f-b1df-651330cfd64a already deleted. [ 798.619024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.619024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.619024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.619024] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.913725] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e8dbf2f-ae7a-484d-a8db-2aca79ca1820 [ 798.913725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.913725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.913725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.913725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.913725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.913725] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e8dbf2f-ae7a-484d-a8db-2aca79ca1820 already deleted. [ 798.913725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e8dbf2f-ae7a-484d-a8db-2aca79ca1820" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.972951] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 007f96f6-a408-4a76-b5c6-eceae8238916: rpc.has_security_group_logging(os_id): False [ 798.995274] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.995804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.995804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.995804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.020026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.021957] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.022093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.022093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.022275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.022360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.022550] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.022662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.022725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.022988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.023111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.024250] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.024433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.024694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.024894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.024968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.025126] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 007f96f6-a408-4a76-b5c6-eceae8238916 is going to be updated. [ 799.031523] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 784e3e36-fad9-4cd6-a173-77329b5f03c2: rpc.has_security_group_logging(os_id): False [ 799.051496] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.051496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.051738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.051781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.051882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.052066] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.052169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.052230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.052393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.052469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.052662] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.052786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.052853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.053020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.053090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.053411] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.053508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.053568] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.053712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.053803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.053895] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 799.097034] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.097201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.097201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.097762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.097762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.112453] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: IN_PROGRESS for 2s [ 799.121563] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.121729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.121779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.121978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.122132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.142017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.142017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.142017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.142017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.142017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.142017] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 665d57cc-5dea-494f-b1df-651330cfd64a already deleted. [ 799.142017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.142017] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 799.143920] env[66364]: INFO networking_nsxv3.common.synchronization [req-ca411f10-4d9c-454b-bdf5-015ead054a0f req-669b40ae-7f76-4255-aed1-07066670094b tempest-ImagesOneServerTestJSON-1626765433 tempest-ImagesOneServerTestJSON-1626765433-project-member] Enqueued Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGHEST for action security_group_members [ 799.144292] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGHEST for action security_group_members [ 799.144592] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9f4a86-c2b4-40ed-8c1d-651067e33449 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.144751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.145640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.145640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.145640] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.145640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.145640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.145640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.145640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.145640] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d9f4a86-c2b4-40ed-8c1d-651067e33449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.555616] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-301 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.555957] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-301" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.555957] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-301" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.556758] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-301" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.556758] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.559032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.559032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.559032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.559185] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.559328] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.559444] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.559555] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.559662] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.559771] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.559877] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.560018] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.599220] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.599220] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.599220] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.599220] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-301" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.599220] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.599220] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.599220] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.601134] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.601411] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63e2b4e3-c0d9-4f69-967e-c5aceaa15e75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.650087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.650087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.650087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.650087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.650087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.650087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.650087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.650087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.650087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.650087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.650087] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 already deleted. [ 799.650087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.107313] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.107537] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.107639] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.108318] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.108490] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.108661] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 63e2b4e3-c0d9-4f69-967e-c5aceaa15e75 not found, creating... [ 800.108974] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.109218] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.109302] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.110208] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.110208] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.110856] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.110856] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.111075] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.111302] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.111395] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.111587] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 63e2b4e3-c0d9-4f69-967e-c5aceaa15e75 is going to be created. [ 800.139770] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.140136] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.140263] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.140701] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.141046] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.141401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.722438] env[66364]: INFO networking_nsxv3.common.synchronization [req-1d20b5e5-d701-40a2-ad19-dc517dc9cd8f req-ef0a0dfd-cb2f-49c9-8907-c20551c13bdb tempest-ServersNegativeTestMultiTenantJSON-1417282816 tempest-ServersNegativeTestMultiTenantJSON-1417282816-project-member] Enqueued Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGHEST for action security_group_members [ 800.723042] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGHEST for action security_group_members [ 800.723372] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.723501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.723583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.723781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.723942] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.724504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.724681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.724915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.725046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.725178] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.826025] env[66364]: INFO networking_nsxv3.common.synchronization [None req-2c98054e-4942-4fa9-a4c0-466020df83ca tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 800.826025] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 800.826025] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.826025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.826025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.826025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.826025] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.836293] env[66364]: INFO networking_nsxv3.common.synchronization [req-ca411f10-4d9c-454b-bdf5-015ead054a0f req-e1fde5f4-08cf-46db-b719-d8ebacb1f529 service nova] Enqueued Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGHEST for action security_group_rules [ 800.836293] env[66364]: INFO networking_nsxv3.common.synchronization [req-ca411f10-4d9c-454b-bdf5-015ead054a0f req-e1fde5f4-08cf-46db-b719-d8ebacb1f529 service nova] Enqueued Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGHEST for action security_group_members [ 800.836293] env[66364]: INFO networking_nsxv3.common.synchronization [req-ca411f10-4d9c-454b-bdf5-015ead054a0f req-e1fde5f4-08cf-46db-b719-d8ebacb1f529 service nova] Enqueued Resource ID: 63e2b4e3-c0d9-4f69-967e-c5aceaa15e75 with Priority: HIGHEST for action port [ 800.836293] env[66364]: INFO networking_nsxv3.common.synchronization [None req-9851b8c5-012c-45e2-9215-6b5188bd680a None None] Enqueued Resource ID: bf0c3d8e-739c-4913-b344-e7ab9f32aafc with Priority: HIGHEST for action port [ 800.836293] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGHEST for action security_group_rules [ 800.836293] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63e2b4e3-c0d9-4f69-967e-c5aceaa15e75 with Priority: HIGHEST for action port [ 800.836293] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGHEST for action security_group_members [ 800.836293] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf0c3d8e-739c-4913-b344-e7ab9f32aafc with Priority: HIGHEST for action port [ 800.836293] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.836293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.836293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.836293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.836293] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d9f4a86-c2b4-40ed-8c1d-651067e33449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.837063] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.837136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.837169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.838488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.838488] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63e2b4e3-c0d9-4f69-967e-c5aceaa15e75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.838488] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9f4a86-c2b4-40ed-8c1d-651067e33449 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.838488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.838488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.838753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.838784] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.839428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.839428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.839428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.839428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.839428] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d9f4a86-c2b4-40ed-8c1d-651067e33449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.840158] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf0c3d8e-739c-4913-b344-e7ab9f32aafc taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.841621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf0c3d8e-739c-4913-b344-e7ab9f32aafc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.841621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf0c3d8e-739c-4913-b344-e7ab9f32aafc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.841621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf0c3d8e-739c-4913-b344-e7ab9f32aafc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.841621] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0c3d8e-739c-4913-b344-e7ab9f32aafc',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.935376] env[66364]: INFO networking_nsxv3.common.synchronization [None req-23267fc3-31ff-4d73-b6e8-7e629726f393 tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 800.935942] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 800.936230] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.936333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.129121] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: SUCCESS [ 801.129348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.161981] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 801.162280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.229023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.229156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.229226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.229441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.229534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.229732] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.229829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.229890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.230048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.230177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.230219] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 is going to be updated. [ 801.261482] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.261482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.262090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.262090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.262090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.271941] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 in Status: IN_PROGRESS for 2s [ 801.345375] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9f4a86-c2b4-40ed-8c1d-651067e33449 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.345508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.345741] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63e2b4e3-c0d9-4f69-967e-c5aceaa15e75 with status ACTIVE [ 801.345883] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.347772] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.347772] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.347772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.347772] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63e2b4e3-c0d9-4f69-967e-c5aceaa15e75 is going to be updated. [ 801.349177] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf0c3d8e-739c-4913-b344-e7ab9f32aafc [ 801.349420] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.349490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.349490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.352047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.352047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.352298] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf0c3d8e-739c-4913-b344-e7ab9f32aafc already deleted. [ 801.352298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf0c3d8e-739c-4913-b344-e7ab9f32aafc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.353321] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.353500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.353554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.353723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.353831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.353914] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a already deleted. [ 801.353999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.354261] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d9f4a86-c2b4-40ed-8c1d-651067e33449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.358386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.359098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.359098] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.388910] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.388910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.388910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.388910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.388910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.389155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63e2b4e3-c0d9-4f69-967e-c5aceaa15e75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.858944] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d9f4a86-c2b4-40ed-8c1d-651067e33449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.885404] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.885631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.885779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.886050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.886182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.886299] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a already deleted. [ 801.886392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.362208] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.362208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.362208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.362208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.362208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.362208] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 is going to be created. [ 802.389974] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.390188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.390235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.390469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.390635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.403571] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 in Status: UNINITIALIZED for 2s [ 803.288631] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 in Status: SUCCESS [ 803.288954] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 deletion is rescheduled due to dependency. [ 803.288954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.415386] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 in Status: SUCCESS [ 804.415386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.415386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.415386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.415386] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.415386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.415386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.416019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.416019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.416019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.416019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d9f4a86-c2b4-40ed-8c1d-651067e33449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.919321] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9f4a86-c2b4-40ed-8c1d-651067e33449 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.919533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.919626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.919942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.920348] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.920562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.920636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.920788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.920939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.921022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.921177] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9f4a86-c2b4-40ed-8c1d-651067e33449 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.921298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.921350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.921571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.921693] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.921790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.921850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.922075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.922304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.922416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.922622] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d9f4a86-c2b4-40ed-8c1d-651067e33449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.427294] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d9f4a86-c2b4-40ed-8c1d-651067e33449: rpc.has_security_group_logging(os_id): False [ 805.448035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.451397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.451573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.451968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.452193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.452608] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.452875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.452990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.457316] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.457316] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.457316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.457316] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 is going to be created. [ 805.528931] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.528931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.528931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.528931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.529108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.546567] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 in Status: IN_PROGRESS for 2s [ 805.936992] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 805.937200] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 806.280291] env[66364]: INFO networking_nsxv3.common.synchronization [req-3a4d0384-3e12-4fba-9979-9f59eec0973e req-83c66b9e-a714-4383-93d4-71784b44b9e4 tempest-ImagesOneServerNegativeTestJSON-519635427 tempest-ImagesOneServerNegativeTestJSON-519635427-project-member] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 806.280902] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 806.281310] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.281442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.281442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.281674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.281813] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.281927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.282079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.282158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.283125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.283125] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.785959] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.786373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.786373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.786453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.808705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.809122] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.809122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.809230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.809386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.809473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.809551] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be updated. [ 806.841792] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.842210] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.842372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.842658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.844020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.856059] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 806.955147] env[66364]: INFO networking_nsxv3.common.synchronization [req-daf259ac-0a7d-424f-bcfc-64509765d9c6 req-cfa94f5a-5a19-4e98-a4e5-42d1769c50e5 tempest-ServersAdminTestJSON-1239172367 tempest-ServersAdminTestJSON-1239172367-project-member] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 806.956103] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 806.956574] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.956780] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.956891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.957193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.957393] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.957521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.957602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.957847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.958023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.958124] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.461088] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.563588] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 in Status: SUCCESS [ 807.563588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.748962] env[66364]: INFO networking_nsxv3.common.synchronization [req-2676228f-7a9d-40d0-b25c-9fe86da5fba2 req-b7455c06-d949-495c-83f1-d325b72ea7a6 tempest-ListServerFiltersTestJSON-936474167 tempest-ListServerFiltersTestJSON-936474167-project-member] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 807.750149] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 807.750149] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.750332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.750332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.750493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.750655] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.750754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.750817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.750968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.751066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.751159] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.964474] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.253568] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.471368] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.471593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.471729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.472020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.472278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.472348] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 808.507852] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.508026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.508071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.508389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.508538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.521105] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 808.757097] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.871425] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 808.871425] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f deletion is rescheduled due to dependency. [ 808.871425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.260564] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.260912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.260912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.261201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.261312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.261472] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be updated. [ 809.301594] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.301837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.301837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.302137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.302241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.314846] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 810.072224] env[66364]: INFO networking_nsxv3.common.synchronization [None req-2bcdf3fa-8364-4130-9c85-869f4ccdcd58 None None] Enqueued Resource ID: 19fed6bd-ace6-457f-bbe7-a7c155111ffa with Priority: HIGHEST for action port [ 810.072512] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19fed6bd-ace6-457f-bbe7-a7c155111ffa with Priority: HIGHEST for action port [ 810.072806] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-19fed6bd-ace6-457f-bbe7-a7c155111ffa taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.072983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19fed6bd-ace6-457f-bbe7-a7c155111ffa" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.073081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19fed6bd-ace6-457f-bbe7-a7c155111ffa" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.073315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19fed6bd-ace6-457f-bbe7-a7c155111ffa" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.073438] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19fed6bd-ace6-457f-bbe7-a7c155111ffa',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.535329] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 810.535762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.576240] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19fed6bd-ace6-457f-bbe7-a7c155111ffa [ 810.576240] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.576240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.576240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.576240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.576240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.576643] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19fed6bd-ace6-457f-bbe7-a7c155111ffa already deleted. [ 810.576643] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19fed6bd-ace6-457f-bbe7-a7c155111ffa" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.847079] env[66364]: INFO networking_nsxv3.common.synchronization [req-d941e5e2-8cd8-4ef7-848c-690f48fafd4c req-04d2b9c5-35f6-4bc8-8acd-3fbdc3cb1058 tempest-ServersWithSpecificFlavorTestJSON-596773426 tempest-ServersWithSpecificFlavorTestJSON-596773426-project-member] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 810.847792] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 810.848406] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.848705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.848705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.849026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.849677] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.849677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.849677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.849677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.849677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.849919] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.157110] env[66364]: INFO networking_nsxv3.common.synchronization [req-12df4188-0477-4c69-a65e-1de4c76830ee req-a9e8f193-683e-43cf-a725-de09f23b6170 tempest-ServersAdminNegativeTestJSON-1819478050 tempest-ServersAdminNegativeTestJSON-1819478050-project-member] Enqueued Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 811.157110] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 811.157336] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.157336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.157440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.157877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.157877] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.157877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.157877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.158182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.158182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.158182] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.235036] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-448 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.235336] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-448" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.235400] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-448" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.235672] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-448" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.235931] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.236097] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.236207] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.236456] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.236600] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.236801] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.237658] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.237658] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.237658] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.237658] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 811.237658] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.237658] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.257673] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.257771] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 811.257920] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.258103] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-448" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.258415] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-eb531a40-89cb-4570-8a6b-36501208c58a taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.258610] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-eb531a40-89cb-4570-8a6b-36501208c58a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.258769] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-eb531a40-89cb-4570-8a6b-36501208c58a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.259151] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-eb531a40-89cb-4570-8a6b-36501208c58a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.259325] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb531a40-89cb-4570-8a6b-36501208c58a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.326097] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 811.326097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.354273] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.354273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.354273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.354273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.377947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.379113] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.379113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.379113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.379113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.379113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.379113] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37506c58-083d-46d9-8010-be6545a2e954 is going to be updated. [ 811.408107] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.408232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.408307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.408595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.408840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.423829] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: IN_PROGRESS for 2s [ 811.662120] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.762802] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.762802] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.762802] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.763167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.763343] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.763491] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port eb531a40-89cb-4570-8a6b-36501208c58a not found, creating... [ 811.763842] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.764129] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.764328] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.764679] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.764913] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.765494] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.765646] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.768636] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.768636] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.768636] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.768636] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: eb531a40-89cb-4570-8a6b-36501208c58a is going to be created. [ 811.790042] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.790337] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.790425] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.790995] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.791133] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.791735] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-eb531a40-89cb-4570-8a6b-36501208c58a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.164288] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.403691] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b5bd4800-25bf-4e4c-b8fa-cbf74be8855f None None] Enqueued Resource ID: 97155928-2523-4c1d-9a6a-97c4e1b45453 with Priority: HIGHEST for action port [ 812.404405] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97155928-2523-4c1d-9a6a-97c4e1b45453 with Priority: HIGHEST for action port [ 812.404747] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-97155928-2523-4c1d-9a6a-97c4e1b45453 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.404898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97155928-2523-4c1d-9a6a-97c4e1b45453" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.404968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97155928-2523-4c1d-9a6a-97c4e1b45453" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.405512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97155928-2523-4c1d-9a6a-97c4e1b45453" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.405621] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97155928-2523-4c1d-9a6a-97c4e1b45453',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.595709] env[66364]: INFO networking_nsxv3.common.synchronization [req-d941e5e2-8cd8-4ef7-848c-690f48fafd4c req-a5de400c-e068-4b0e-a595-ab5d63da95bb service nova] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_rules [ 812.595888] env[66364]: INFO networking_nsxv3.common.synchronization [req-d941e5e2-8cd8-4ef7-848c-690f48fafd4c req-a5de400c-e068-4b0e-a595-ab5d63da95bb service nova] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 812.596032] env[66364]: INFO networking_nsxv3.common.synchronization [req-d941e5e2-8cd8-4ef7-848c-690f48fafd4c req-a5de400c-e068-4b0e-a595-ab5d63da95bb service nova] Enqueued Resource ID: eb531a40-89cb-4570-8a6b-36501208c58a with Priority: HIGHEST for action port [ 812.596580] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_rules [ 812.596754] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 812.596854] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb531a40-89cb-4570-8a6b-36501208c58a with Priority: HIGHEST for action port [ 812.600503] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.600639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.600710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.600967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.601101] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.603498] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.603842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.604016] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb531a40-89cb-4570-8a6b-36501208c58a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.604148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb531a40-89cb-4570-8a6b-36501208c58a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.604445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb531a40-89cb-4570-8a6b-36501208c58a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.604445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb531a40-89cb-4570-8a6b-36501208c58a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.604513] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb531a40-89cb-4570-8a6b-36501208c58a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.669947] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.669947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.669947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.669947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.669947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.669947] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007f96f6-a408-4a76-b5c6-eceae8238916 is going to be updated. [ 812.700119] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.700940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.700940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.700940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.700940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.712635] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: IN_PROGRESS for 2s [ 812.908025] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97155928-2523-4c1d-9a6a-97c4e1b45453 [ 812.908025] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.908424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.909014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.909014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.909132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.909170] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97155928-2523-4c1d-9a6a-97c4e1b45453 already deleted. [ 812.909239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97155928-2523-4c1d-9a6a-97c4e1b45453" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.106518] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.106669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.106852] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb531a40-89cb-4570-8a6b-36501208c58a with status ACTIVE [ 813.107024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.107133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.107197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.107412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.107508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.107655] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.107741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.107795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.107945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.108024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.108212] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.108290] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.108354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.108493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.108563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.108642] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb531a40-89cb-4570-8a6b-36501208c58a is going to be updated. [ 813.129762] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.129949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.129995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.130213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.130349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.130509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb531a40-89cb-4570-8a6b-36501208c58a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.434701] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: SUCCESS [ 813.434908] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37506c58-083d-46d9-8010-be6545a2e954 deletion is rescheduled due to dependency. [ 813.435049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.435371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.435702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.436063] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.436247] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.436327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.436538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.436614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.436736] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.939937] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.442200] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.725021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: SUCCESS [ 814.725583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.946087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.946087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.946087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.946087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.946087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.946886] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37506c58-083d-46d9-8010-be6545a2e954 is going to be updated. [ 814.982638] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.982638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.982749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.984476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.984476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.998671] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: IN_PROGRESS for 2s [ 817.012119] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: SUCCESS [ 817.012540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.012608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.012885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.013195] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.032639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.032639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.032639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.032639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.032639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.032639] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.520700] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.598458] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 817.598458] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 818.025598] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37506c58-083d-46d9-8010-be6545a2e954: rpc.has_security_group_logging(os_id): False [ 818.045499] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.045499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.045499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.046452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.046560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.046840] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.046945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.047018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.047202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.047263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.047351] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37506c58-083d-46d9-8010-be6545a2e954 is going to be updated. [ 818.109992] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.110107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.110168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.111056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.111056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.127109] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: IN_PROGRESS for 2s [ 818.555405] env[66364]: INFO networking_nsxv3.common.synchronization [None req-0bcd7b56-7813-4f59-b39d-4822e3cef404 None None] Enqueued Resource ID: 3615654f-ffa2-41f4-92e9-36192e2b125b with Priority: HIGHEST for action port [ 818.557467] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3615654f-ffa2-41f4-92e9-36192e2b125b with Priority: HIGHEST for action port [ 818.557875] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-3615654f-ffa2-41f4-92e9-36192e2b125b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.558042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3615654f-ffa2-41f4-92e9-36192e2b125b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.558125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3615654f-ffa2-41f4-92e9-36192e2b125b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.558435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3615654f-ffa2-41f4-92e9-36192e2b125b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.558541] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3615654f-ffa2-41f4-92e9-36192e2b125b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.060798] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3615654f-ffa2-41f4-92e9-36192e2b125b [ 819.062189] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.062189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.062189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.062189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.062189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.062189] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3615654f-ffa2-41f4-92e9-36192e2b125b already deleted. [ 819.062189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3615654f-ffa2-41f4-92e9-36192e2b125b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.837231] env[66364]: INFO networking_nsxv3.common.synchronization [None req-c67bb509-cfd9-46f0-a24a-b77bdb09ef86 tempest-ServerActionsTestOtherB-1668111998 tempest-ServerActionsTestOtherB-1668111998-project-member] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 819.837916] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 819.839798] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.839798] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.839798] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.839798] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.842043] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.044215] env[66364]: INFO networking_nsxv3.common.synchronization [None req-07ba2040-dc9f-4c64-bfe5-92eb720c9a75 tempest-ServerActionsTestOtherB-1668111998 tempest-ServerActionsTestOtherB-1668111998-project-member] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 820.044857] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 820.045064] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.045180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.144289] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: SUCCESS [ 820.144631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.365995] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.366176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.366231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.366463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.366575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.366675] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 already deleted. [ 820.366761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.366914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.367148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.367232] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.521031] env[66364]: INFO networking_nsxv3.common.synchronization [None req-ca9c900d-1a1e-432f-8f29-587ddeafea21 None None] Enqueued Resource ID: f884db7d-5422-4c5e-b39a-474124db94c8 with Priority: HIGHEST for action port [ 820.521380] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f884db7d-5422-4c5e-b39a-474124db94c8 with Priority: HIGHEST for action port [ 820.521699] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-f884db7d-5422-4c5e-b39a-474124db94c8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.521821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f884db7d-5422-4c5e-b39a-474124db94c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.521886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f884db7d-5422-4c5e-b39a-474124db94c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.522144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f884db7d-5422-4c5e-b39a-474124db94c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.522230] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f884db7d-5422-4c5e-b39a-474124db94c8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.889540] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.889698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.889698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.889839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.890395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.890985] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 already deleted. [ 820.890985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.025033] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f884db7d-5422-4c5e-b39a-474124db94c8 [ 821.026807] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.026807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.026807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.026807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.026807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.026807] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f884db7d-5422-4c5e-b39a-474124db94c8 already deleted. [ 821.026807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f884db7d-5422-4c5e-b39a-474124db94c8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.271321] env[66364]: INFO networking_nsxv3.common.synchronization [None req-e6725da0-e50b-415a-87fd-11f5ecc87aab None None] Enqueued Resource ID: 96101420-71a6-4c53-9e9b-3999661266eb with Priority: HIGHEST for action port [ 821.271321] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96101420-71a6-4c53-9e9b-3999661266eb with Priority: HIGHEST for action port [ 821.271321] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-96101420-71a6-4c53-9e9b-3999661266eb taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.271992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96101420-71a6-4c53-9e9b-3999661266eb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.272454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96101420-71a6-4c53-9e9b-3999661266eb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.274327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96101420-71a6-4c53-9e9b-3999661266eb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.274327] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96101420-71a6-4c53-9e9b-3999661266eb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.774566] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96101420-71a6-4c53-9e9b-3999661266eb [ 821.774837] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.775426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.775426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.775426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.775426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.775796] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96101420-71a6-4c53-9e9b-3999661266eb already deleted. [ 821.775796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96101420-71a6-4c53-9e9b-3999661266eb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.216759] env[66364]: INFO networking_nsxv3.common.synchronization [req-d7a7cec2-d777-4325-aeda-a29009273ecd req-39d92150-3fa6-484d-a394-1d6c8afd1527 tempest-ServerActionsV293TestJSON-383694888 tempest-ServerActionsV293TestJSON-383694888-project-member] Enqueued Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_members [ 822.217312] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_members [ 822.217615] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4749461-177d-4d2d-9817-47596fbff3b5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.218461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.218461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.218461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.218461] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.218698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.218881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.219152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.219241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.219346] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.629525] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-783 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.629838] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-783" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.629991] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-783" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.630525] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-783" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.631455] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.631741] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.631882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.632162] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.632313] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.632550] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.632666] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.632776] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.632882] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.633101] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.633225] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.633401] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.657661] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.657832] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.657985] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.658198] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-783" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.658544] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-c4d31850-2e5d-44d1-8032-3ea578e13388 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.658733] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-c4d31850-2e5d-44d1-8032-3ea578e13388" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.658861] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-c4d31850-2e5d-44d1-8032-3ea578e13388" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.659260] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-c4d31850-2e5d-44d1-8032-3ea578e13388" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.659417] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d31850-2e5d-44d1-8032-3ea578e13388',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.722248] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.722436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.722498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.722794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.722851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.723299] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.723299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.723299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.723476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.723476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.723672] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4749461-177d-4d2d-9817-47596fbff3b5 already deleted. [ 822.723672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.790823] env[66364]: INFO networking_nsxv3.common.synchronization [None req-c68d8cea-0b88-48d8-80a0-a298790b028d None None] Enqueued Resource ID: ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5 with Priority: HIGHEST for action port [ 822.790823] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5 with Priority: HIGHEST for action port [ 822.795486] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.796033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.796033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.796355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.797384] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.163388] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.163628] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.163730] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.167585] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.167585] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.167585] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port c4d31850-2e5d-44d1-8032-3ea578e13388 not found, creating... [ 823.167585] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.167585] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.167585] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.167585] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.167585] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.167585] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.167585] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.168088] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.168333] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.168522] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.168723] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: c4d31850-2e5d-44d1-8032-3ea578e13388 is going to be created. [ 823.189581] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.189808] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.189937] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.190253] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.190522] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.190755] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-c4d31850-2e5d-44d1-8032-3ea578e13388" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.299443] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5 [ 823.299648] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.299784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.299818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.301028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.301028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.301028] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5 already deleted. [ 823.301028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebcd1a15-7cd3-44e7-8c42-2c2d4dbc18e5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.889138] env[66364]: INFO networking_nsxv3.common.synchronization [req-d7a7cec2-d777-4325-aeda-a29009273ecd req-c590101b-b6ec-4c5b-a419-6c8cec384ebe service nova] Enqueued Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_rules [ 823.889461] env[66364]: INFO networking_nsxv3.common.synchronization [req-d7a7cec2-d777-4325-aeda-a29009273ecd req-c590101b-b6ec-4c5b-a419-6c8cec384ebe service nova] Enqueued Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_members [ 823.889461] env[66364]: INFO networking_nsxv3.common.synchronization [req-d7a7cec2-d777-4325-aeda-a29009273ecd req-c590101b-b6ec-4c5b-a419-6c8cec384ebe service nova] Enqueued Resource ID: c4d31850-2e5d-44d1-8032-3ea578e13388 with Priority: HIGHEST for action port [ 823.890420] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_rules [ 823.890571] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_members [ 823.890683] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4d31850-2e5d-44d1-8032-3ea578e13388 with Priority: HIGHEST for action port [ 823.891145] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4749461-177d-4d2d-9817-47596fbff3b5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.891286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.894811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.895101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.895196] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.896232] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4749461-177d-4d2d-9817-47596fbff3b5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.896379] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.896463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.896671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.896865] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.896986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.897093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.897253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.897366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.897465] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.900060] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4d31850-2e5d-44d1-8032-3ea578e13388 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.900395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4d31850-2e5d-44d1-8032-3ea578e13388" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.900395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4d31850-2e5d-44d1-8032-3ea578e13388" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.900476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4d31850-2e5d-44d1-8032-3ea578e13388" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.900514] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d31850-2e5d-44d1-8032-3ea578e13388',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.402705] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4749461-177d-4d2d-9817-47596fbff3b5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.404476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.407356] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.409047] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4d31850-2e5d-44d1-8032-3ea578e13388 with status ACTIVE [ 824.409047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.409047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.409236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.409619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.409619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.409759] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.409759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.409854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.411165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.411718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.411718] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.411718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.411910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.412147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.412321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.412653] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4d31850-2e5d-44d1-8032-3ea578e13388 is going to be updated. [ 824.438190] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.438445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.438565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.438829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.439080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.439308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4d31850-2e5d-44d1-8032-3ea578e13388" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.915973] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.419238] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.419436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.419843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.420062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.420186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.421052] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4749461-177d-4d2d-9817-47596fbff3b5 is going to be created. [ 825.451679] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.451833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.451902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.452150] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.452314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.464200] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4749461-177d-4d2d-9817-47596fbff3b5 in Status: UNINITIALIZED for 2s [ 827.482037] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4749461-177d-4d2d-9817-47596fbff3b5 in Status: SUCCESS [ 827.482473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.482591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.483895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.483895] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.483895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.483895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.483895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.483895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.483895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.483895] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.533619] env[66364]: INFO networking_nsxv3.common.synchronization [req-aa1c3b28-cd78-4327-a73c-0dc216359f7b req-ecc46699-76e8-490d-ad75-a1abf76aeb25 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 827.533619] env[66364]: INFO networking_nsxv3.common.synchronization [req-aa1c3b28-cd78-4327-a73c-0dc216359f7b req-ecc46699-76e8-490d-ad75-a1abf76aeb25 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 827.533619] env[66364]: INFO networking_nsxv3.common.synchronization [req-aa1c3b28-cd78-4327-a73c-0dc216359f7b req-ecc46699-76e8-490d-ad75-a1abf76aeb25 tempest-SecurityGroupsTestJSON-199352406 tempest-SecurityGroupsTestJSON-199352406-project-member] Enqueued Resource ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a with Priority: HIGHEST for action security_group_members [ 827.534323] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGHEST for action security_group_members [ 827.534556] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGHEST for action security_group_members [ 827.535017] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a with Priority: HIGHEST for action security_group_members [ 827.535017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.535017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.535205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.535295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.535433] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.535541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.535683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.535968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.535968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.535968] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.536852] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.536980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.536980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.537328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.538035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.538035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.538035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.538035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.538035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.538035] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.539800] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1358a0-c55b-4cc7-8303-f2d79335b98a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.539800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.539800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.539800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.539800] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.539800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.539800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.539800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.539800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.540645] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb1358a0-c55b-4cc7-8303-f2d79335b98a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.831695] env[66364]: INFO networking_nsxv3.common.synchronization [req-214f3944-af67-404d-926f-dd7d7b40a019 req-a3bf5e8c-12a7-4121-89b1-caaafad63408 tempest-ServerExternalEventsTest-364789271 tempest-ServerExternalEventsTest-364789271-project-member] Enqueued Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGHEST for action security_group_members [ 827.832318] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGHEST for action security_group_members [ 827.833239] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a79a858-0e03-4c0f-8127-6d5008465f85 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.833388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.833458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.833710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.833868] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.833972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.834044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.834201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.834285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.834379] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a79a858-0e03-4c0f-8127-6d5008465f85',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.987392] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.042285] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.042629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.042737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.043065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.043178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.043423] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.043541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.043612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.043852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.043921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.044183] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be updated. [ 828.045878] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.046082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.046197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.046498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.046640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.047119] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.047320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.047385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.047819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.047960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.048127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df21da4b-98ac-4bfa-b751-65483a460873 is going to be updated. [ 828.050149] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.050315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.050431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.050706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.087362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.087679] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.087815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.087953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.088753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.088882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.089017] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a is going to be updated. [ 828.099553] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.099719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.099905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.100199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.100363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.104316] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.104316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.104316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.104316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.104316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.112928] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: IN_PROGRESS for 2s [ 828.124947] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: IN_PROGRESS for 2s [ 828.139694] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.139901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.139901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.140476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.140476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.151756] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a in Status: IN_PROGRESS for 2s [ 828.216766] env[66364]: INFO networking_nsxv3.common.synchronization [req-64213997-a49e-46c0-b48f-4129b89d133f req-ceb05249-3c6d-4af7-96a0-8da09847aca0 tempest-ServersTestJSON-1686957391 tempest-ServersTestJSON-1686957391-project-member] Enqueued Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_members [ 828.222479] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 with Priority: HIGHEST for action security_group_members [ 828.223123] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.223123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.223123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.223376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.223553] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.223667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.223753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.223931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.224035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.224141] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c50ff812-f9eb-4476-8c5b-45d3cc1a4532',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.338495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.338495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.338495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.338495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.338495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.338495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.338495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.338495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.338495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.338495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.338495] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 already deleted. [ 828.338495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.492030] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4749461-177d-4d2d-9817-47596fbff3b5: rpc.has_security_group_logging(os_id): False [ 828.517773] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.517892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.517953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.518363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.518363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.518616] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.518740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.518800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.518943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.519020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.519102] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4749461-177d-4d2d-9817-47596fbff3b5 is going to be created. [ 828.552914] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.552914] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.552914] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.552914] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.552914] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.552914] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.552914] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.553899] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.554467] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.554467] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.554467] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.554732] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.554732] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.554858] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.554914] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.555157] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.595745] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.596132] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.596299] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.596598] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.597490] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-4a5a8714-3ce5-43d2-80ad-6471970e2449 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.597805] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-4a5a8714-3ce5-43d2-80ad-6471970e2449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.598064] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-4a5a8714-3ce5-43d2-80ad-6471970e2449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.598399] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-4a5a8714-3ce5-43d2-80ad-6471970e2449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.598569] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a5a8714-3ce5-43d2-80ad-6471970e2449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.630052] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.630317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.630317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.630490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.630665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.644671] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4749461-177d-4d2d-9817-47596fbff3b5 in Status: IN_PROGRESS for 2s [ 828.730521] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.730723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.730778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.731136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.756550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.756835] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.756959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.757031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.757490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.757490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.757490] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 is going to be updated. [ 828.791291] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.791569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.791569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.792240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.792240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.817738] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 in Status: IN_PROGRESS for 2s [ 829.101637] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.101910] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.102016] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.102372] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.102522] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.102679] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 4a5a8714-3ce5-43d2-80ad-6471970e2449 not found, creating... [ 829.102944] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.103213] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.103328] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.103559] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.103694] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.104118] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.104296] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.104405] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.104614] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.104743] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.104876] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 4a5a8714-3ce5-43d2-80ad-6471970e2449 is going to be created. [ 829.128171] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.128582] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.128582] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.128815] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.129052] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.129312] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-4a5a8714-3ce5-43d2-80ad-6471970e2449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.809421] env[66364]: INFO networking_nsxv3.common.synchronization [req-214f3944-af67-404d-926f-dd7d7b40a019 req-cdeb2050-b3f0-40a8-9e9e-90c88db384eb service nova] Enqueued Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGHEST for action security_group_rules [ 829.809703] env[66364]: INFO networking_nsxv3.common.synchronization [req-214f3944-af67-404d-926f-dd7d7b40a019 req-cdeb2050-b3f0-40a8-9e9e-90c88db384eb service nova] Enqueued Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGHEST for action security_group_members [ 829.809795] env[66364]: INFO networking_nsxv3.common.synchronization [req-214f3944-af67-404d-926f-dd7d7b40a019 req-cdeb2050-b3f0-40a8-9e9e-90c88db384eb service nova] Enqueued Resource ID: 4a5a8714-3ce5-43d2-80ad-6471970e2449 with Priority: HIGHEST for action port [ 829.810278] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGHEST for action security_group_rules [ 829.810450] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGHEST for action security_group_members [ 829.810495] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a5a8714-3ce5-43d2-80ad-6471970e2449 with Priority: HIGHEST for action port [ 829.810761] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a79a858-0e03-4c0f-8127-6d5008465f85 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.810927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.810995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.811239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.811320] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a79a858-0e03-4c0f-8127-6d5008465f85',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.812199] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a79a858-0e03-4c0f-8127-6d5008465f85 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.812316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.812385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.812563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.812705] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.812798] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.812846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.813021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.813109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.813199] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a79a858-0e03-4c0f-8127-6d5008465f85',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.814715] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a5a8714-3ce5-43d2-80ad-6471970e2449 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.814715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a5a8714-3ce5-43d2-80ad-6471970e2449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.814715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a5a8714-3ce5-43d2-80ad-6471970e2449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.814715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a5a8714-3ce5-43d2-80ad-6471970e2449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.814715] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a5a8714-3ce5-43d2-80ad-6471970e2449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.997199] env[66364]: INFO networking_nsxv3.common.synchronization [None req-6244caf5-1d18-495d-a451-3cb6e125eabf None None] Enqueued Resource ID: ad4df556-c94f-4609-ae9e-27afee5f251f with Priority: HIGHEST for action port [ 829.997820] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4df556-c94f-4609-ae9e-27afee5f251f with Priority: HIGHEST for action port [ 829.999931] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad4df556-c94f-4609-ae9e-27afee5f251f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.000084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad4df556-c94f-4609-ae9e-27afee5f251f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.000166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad4df556-c94f-4609-ae9e-27afee5f251f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.000548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad4df556-c94f-4609-ae9e-27afee5f251f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.000548] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad4df556-c94f-4609-ae9e-27afee5f251f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.124314] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df21da4b-98ac-4bfa-b751-65483a460873 in Status: SUCCESS [ 830.124714] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df21da4b-98ac-4bfa-b751-65483a460873 deletion is rescheduled due to dependency. [ 830.124714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.136038] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ef17dd-12b4-4751-91bb-321b509b882e in Status: SUCCESS [ 830.136038] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e deletion is rescheduled due to dependency. [ 830.136038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.162461] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a in Status: SUCCESS [ 830.162461] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb1358a0-c55b-4cc7-8303-f2d79335b98a deletion is rescheduled due to dependency. [ 830.162461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1358a0-c55b-4cc7-8303-f2d79335b98a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.321127] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a79a858-0e03-4c0f-8127-6d5008465f85',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.321127] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a79a858-0e03-4c0f-8127-6d5008465f85 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.321127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.321127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a5a8714-3ce5-43d2-80ad-6471970e2449 with status ACTIVE [ 830.321127] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.321127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.321127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.321127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.321127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.321127] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.321127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.321127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.321127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.321127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.322512] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.322512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.322512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.322512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.322512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.322512] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a5a8714-3ce5-43d2-80ad-6471970e2449 is going to be updated. [ 830.343178] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.343322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.343461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.343589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.343725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.343884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a5a8714-3ce5-43d2-80ad-6471970e2449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.503660] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad4df556-c94f-4609-ae9e-27afee5f251f [ 830.504663] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.504663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.504663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.504663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.504663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.504663] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad4df556-c94f-4609-ae9e-27afee5f251f already deleted. [ 830.504663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad4df556-c94f-4609-ae9e-27afee5f251f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.660822] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4749461-177d-4d2d-9817-47596fbff3b5 in Status: SUCCESS [ 830.661184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.825112] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a79a858-0e03-4c0f-8127-6d5008465f85',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.829055] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 in Status: SUCCESS [ 830.829202] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c50ff812-f9eb-4476-8c5b-45d3cc1a4532 deletion is rescheduled due to dependency. [ 830.829317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c50ff812-f9eb-4476-8c5b-45d3cc1a4532" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.993101] env[66364]: INFO networking_nsxv3.common.synchronization [None req-bb920a92-4668-48c5-9bb0-207d39ae3410 tempest-ServersTestFqdnHostnames-2079979295 tempest-ServersTestFqdnHostnames-2079979295-project-member] Enqueued Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_rules [ 830.993649] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_rules [ 830.993950] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.994934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.995033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.995399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.996252] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.134810] env[66364]: INFO networking_nsxv3.common.synchronization [None req-c5767135-9199-4ec5-84e1-a8230630e6e6 tempest-ServersTestFqdnHostnames-2079979295 tempest-ServersTestFqdnHostnames-2079979295-project-member] Enqueued Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_rules [ 831.135398] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_rules [ 831.135741] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.135837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.327790] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.328478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.328478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.328478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.328478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.328478] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 is going to be created. [ 831.356209] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.357237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.357237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.357237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.357237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.369111] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 in Status: UNINITIALIZED for 2s [ 831.519251] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.519450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.519521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.519773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.519867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.519970] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 already deleted. [ 831.520067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.520216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.520373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.520455] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.043596] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.043596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.043596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.043596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.043596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.043596] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 already deleted. [ 832.043596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.404155] env[66364]: INFO networking_nsxv3.common.synchronization [None req-74552d39-51f4-4cb1-b4c2-1d7027120677 None None] Enqueued Resource ID: 5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1 with Priority: HIGHEST for action port [ 832.405415] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1 with Priority: HIGHEST for action port [ 832.405415] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.405415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.405415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.405632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.405632] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.908675] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1 [ 832.909207] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.909207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.909473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.909892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.910052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.910240] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1 already deleted. [ 832.910369] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fa5bfe8-b7f4-44f1-ac5b-c60aa8712ee1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.379081] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 in Status: SUCCESS [ 833.379457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.379633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.380522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.380522] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.380522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.380522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.380522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.380803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.380803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.380803] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a79a858-0e03-4c0f-8127-6d5008465f85',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.507643] env[66364]: INFO networking_nsxv3.common.synchronization [req-17fa4802-d9ae-4910-b58b-2708ec68a05e req-b75aecb7-8913-4dc0-9a7d-937440e130b2 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 833.508305] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 833.508676] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.508794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.508864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.509152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.510190] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.510190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.510190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.510190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.510190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.510503] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.884035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a79a858-0e03-4c0f-8127-6d5008465f85 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.884305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.884383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.884678] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.884788] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.884901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.884981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.885114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.885202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.885289] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.885441] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a79a858-0e03-4c0f-8127-6d5008465f85 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.885528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.885604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.885723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.885858] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.885940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.886081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.886260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.886341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.886404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.886497] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a79a858-0e03-4c0f-8127-6d5008465f85',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.012423] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.012423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.012666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.012666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.012826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.012957] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.013122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.013203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.013312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.013390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.013476] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd already deleted. [ 834.013556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.355890] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.356154] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-633" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.356233] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-633" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.356589] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-633" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.358699] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.358878] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.358996] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.359263] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.359410] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.359622] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.359733] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.359837] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.359941] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.360061] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.360168] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.360334] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.380455] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.380800] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 834.380800] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.380946] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-633" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.381332] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.381511] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.381626] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.381933] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.382080] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce9c8a49-0dba-42cc-83d9-35c60c06c4f3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.388810] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a79a858-0e03-4c0f-8127-6d5008465f85: rpc.has_security_group_logging(os_id): False [ 834.407268] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.407355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.407462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.407618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.407734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.407910] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.408047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.408110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.408231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.408343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.408475] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.408604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.408650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.408755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.408861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.409010] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.409123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.409165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.409292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.409391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.409434] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 is going to be created. [ 834.473688] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.473841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.473908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.474169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.474360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.491944] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 in Status: IN_PROGRESS for 2s [ 834.884615] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.885267] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.885518] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.886905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.886905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.886905] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 not found, creating... [ 834.886905] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.886905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.886905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.886905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.887417] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.887617] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.887824] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.887990] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.888283] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.888811] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.889020] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 is going to be created. [ 834.910467] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.910693] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.910799] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.911167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.911426] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.911619] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.382987] env[66364]: INFO networking_nsxv3.common.synchronization [None req-0ef20af9-0cb4-4156-9101-cd3fa8292ad5 None None] Enqueued Resource ID: a965e684-37ac-4108-874a-84783aa7522d with Priority: HIGHEST for action port [ 835.383830] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a965e684-37ac-4108-874a-84783aa7522d with Priority: HIGHEST for action port [ 835.384476] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-a965e684-37ac-4108-874a-84783aa7522d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.384604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a965e684-37ac-4108-874a-84783aa7522d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.384672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a965e684-37ac-4108-874a-84783aa7522d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.385091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a965e684-37ac-4108-874a-84783aa7522d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.385185] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a965e684-37ac-4108-874a-84783aa7522d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.633484] env[66364]: INFO networking_nsxv3.common.synchronization [req-17fa4802-d9ae-4910-b58b-2708ec68a05e req-eb26a599-fa0e-4a96-ae02-4b796e07c650 service nova] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_rules [ 835.633707] env[66364]: INFO networking_nsxv3.common.synchronization [req-17fa4802-d9ae-4910-b58b-2708ec68a05e req-eb26a599-fa0e-4a96-ae02-4b796e07c650 service nova] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 835.633889] env[66364]: INFO networking_nsxv3.common.synchronization [req-17fa4802-d9ae-4910-b58b-2708ec68a05e req-eb26a599-fa0e-4a96-ae02-4b796e07c650 service nova] Enqueued Resource ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 with Priority: HIGHEST for action port [ 835.636191] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_rules [ 835.636191] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 835.636191] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 with Priority: HIGHEST for action port [ 835.636191] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.636191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.636191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.636191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.636191] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.637375] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.637516] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.637576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.637721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.637901] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.638045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.638045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.638188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.638470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.638470] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.639154] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.639491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.639603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.640731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.640731] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce9c8a49-0dba-42cc-83d9-35c60c06c4f3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.889480] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a965e684-37ac-4108-874a-84783aa7522d [ 835.889762] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.889919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.889990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.890257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.890617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.890617] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a965e684-37ac-4108-874a-84783aa7522d already deleted. [ 835.890617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a965e684-37ac-4108-874a-84783aa7522d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.143023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.143023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.143023] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.143522] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 with status ACTIVE [ 836.143980] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.143980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.143980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.144218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.144312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.144495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.144615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.144753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.144857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.144902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.146167] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.146317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.146381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.146580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.146658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.146745] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 is going to be updated. [ 836.177209] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.177564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.177564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.177793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.177930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.178115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.506750] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 in Status: SUCCESS [ 836.507091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.653448] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.155851] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.156025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.156104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.156279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.156371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.156463] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd is going to be created. [ 837.186046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.186270] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.186327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.186507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.186796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.201457] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: UNINITIALIZED for 2s [ 838.005348] env[66364]: INFO networking_nsxv3.common.synchronization [None req-1a65f4f2-48bf-413d-8ffa-51ca72d01e3d None None] Enqueued Resource ID: a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6 with Priority: HIGHEST for action port [ 838.005348] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6 with Priority: HIGHEST for action port [ 838.006394] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.006394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.006394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.006394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.008652] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.513446] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6 [ 838.514213] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.514213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.514414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.514514] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.515692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.515692] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6 already deleted. [ 838.515692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0e436a9-8dfc-4ae4-809c-9eacd31fe0d6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.684664] env[66364]: INFO networking_nsxv3.common.synchronization [req-48f15078-7124-491d-a24a-6578a849431f req-b342776f-a7b6-4ae7-b8b0-e13dc0df5d82 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_members [ 838.685883] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_members [ 838.686310] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-665d57cc-5dea-494f-b1df-651330cfd64a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.686457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.686574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.686885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.687124] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.687454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.687541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.688470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.688470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.688470] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.084966] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-319 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.084966] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.085624] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.085987] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.089374] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.089600] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.089728] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.090156] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.090391] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.090727] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.090846] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.091444] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.091444] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.091444] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.091444] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.091631] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.113037] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.114100] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 839.114100] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.114100] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.114100] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-fec9a794-599d-4286-a699-bef29e5c2245 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.114100] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-fec9a794-599d-4286-a699-bef29e5c2245" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.114404] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-fec9a794-599d-4286-a699-bef29e5c2245" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.114671] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-fec9a794-599d-4286-a699-bef29e5c2245" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.114840] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fec9a794-599d-4286-a699-bef29e5c2245',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.192519] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.192838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.192943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.193223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.193319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.193525] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.193624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.193688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.193891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.193957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.193989] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 665d57cc-5dea-494f-b1df-651330cfd64a already deleted. [ 839.194099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.210973] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: UNINITIALIZED for 4s [ 839.621618] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.621931] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.622092] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.622395] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.623070] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.623070] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port fec9a794-599d-4286-a699-bef29e5c2245 not found, creating... [ 839.623209] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.623346] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.623483] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.623735] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.623932] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.629019] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.629019] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.629019] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.629019] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.629019] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.629019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: fec9a794-599d-4286-a699-bef29e5c2245 is going to be created. [ 839.652377] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.652662] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.653023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.653275] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.654017] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.654017] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-fec9a794-599d-4286-a699-bef29e5c2245" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.443449] env[66364]: INFO networking_nsxv3.common.synchronization [req-48f15078-7124-491d-a24a-6578a849431f req-ce756d7c-a60a-4773-ac1d-c0272207913f service nova] Enqueued Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_rules [ 840.443449] env[66364]: INFO networking_nsxv3.common.synchronization [req-48f15078-7124-491d-a24a-6578a849431f req-ce756d7c-a60a-4773-ac1d-c0272207913f service nova] Enqueued Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_members [ 840.443449] env[66364]: INFO networking_nsxv3.common.synchronization [req-48f15078-7124-491d-a24a-6578a849431f req-ce756d7c-a60a-4773-ac1d-c0272207913f service nova] Enqueued Resource ID: fec9a794-599d-4286-a699-bef29e5c2245 with Priority: HIGHEST for action port [ 840.443449] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_rules [ 840.443449] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_members [ 840.443449] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fec9a794-599d-4286-a699-bef29e5c2245 with Priority: HIGHEST for action port [ 840.443909] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-665d57cc-5dea-494f-b1df-651330cfd64a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.443909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.443909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.443909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.444147] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.445327] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-665d57cc-5dea-494f-b1df-651330cfd64a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.445473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.446442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.446442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.446442] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.446442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.446442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.446442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.446442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.446442] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.447803] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-fec9a794-599d-4286-a699-bef29e5c2245 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.447803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fec9a794-599d-4286-a699-bef29e5c2245" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.447803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fec9a794-599d-4286-a699-bef29e5c2245" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.447803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fec9a794-599d-4286-a699-bef29e5c2245" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.447803] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fec9a794-599d-4286-a699-bef29e5c2245',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.953883] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.958282] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-665d57cc-5dea-494f-b1df-651330cfd64a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.958282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.958282] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fec9a794-599d-4286-a699-bef29e5c2245 with status ACTIVE [ 840.958282] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.958282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.958282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.958282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.958282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.958282] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.958282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.958282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.958282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.958282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.959030] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.959030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.959030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.959030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.959030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.959030] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fec9a794-599d-4286-a699-bef29e5c2245 is going to be updated. [ 840.986830] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.987034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.987081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.987303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.988156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.988156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fec9a794-599d-4286-a699-bef29e5c2245" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.224211] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: SUCCESS [ 841.224800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.224800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.224995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.225658] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.225658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.225658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.225658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.225658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.225920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.225920] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.463455] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.729048] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.729215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.729262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.729477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.729655] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.729755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.729818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.729967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.730066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.730160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.730305] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.730393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.730447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.730603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.730748] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.730805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.730843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.730964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.731049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.731128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.731217] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.971709] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.971709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.971709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.971709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.971709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.971709] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 665d57cc-5dea-494f-b1df-651330cfd64a is going to be created. [ 841.996262] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.996497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.996497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.996717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.996878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.008989] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 665d57cc-5dea-494f-b1df-651330cfd64a in Status: UNINITIALIZED for 2s [ 842.233425] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92790af5-7562-4576-af5a-785b171701bd: rpc.has_security_group_logging(os_id): False [ 842.256978] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.257160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.257212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.258063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.258063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.258063] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.258063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.258063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.258063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.258063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.258488] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.258488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.258488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.258488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.258670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.258780] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.258877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.258917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.261980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.261980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.261980] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92790af5-7562-4576-af5a-785b171701bd is going to be created. [ 842.311627] env[66364]: INFO networking_nsxv3.common.synchronization [req-d0ec4317-4288-42e6-9b90-a6b644cfa079 req-0ba14c39-0ec9-4950-8dd2-f0a995baa23f tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 842.311627] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 842.311627] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.311627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.311627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.312453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.312453] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.312453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.312453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.312453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.312721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.312721] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.340550] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.340698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.340765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.340987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.341325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.358127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: IN_PROGRESS for 2s [ 842.737485] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.737485] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.737485] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.737485] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.737485] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.738326] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.738909] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.739342] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.739747] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.740110] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.740360] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.740679] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.741031] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.741300] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.741540] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.741899] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.769082] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.769082] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 842.769082] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.769082] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.769347] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-1f8107c7-14fb-4465-ae7b-e1665ba3838a taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.769492] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-1f8107c7-14fb-4465-ae7b-e1665ba3838a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.769622] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-1f8107c7-14fb-4465-ae7b-e1665ba3838a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.769926] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-1f8107c7-14fb-4465-ae7b-e1665ba3838a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.770412] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f8107c7-14fb-4465-ae7b-e1665ba3838a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.816024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.816242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.816293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.816571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.816890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.816988] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.817108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.817179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.817347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.817425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.817507] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a already deleted. [ 842.817586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.273687] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.274809] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.275150] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.275634] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.275848] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.276067] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 1f8107c7-14fb-4465-ae7b-e1665ba3838a not found, creating... [ 843.276407] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.276599] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.276716] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.276976] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.277177] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.277525] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.277709] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.277829] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.278130] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.278329] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.278521] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 1f8107c7-14fb-4465-ae7b-e1665ba3838a is going to be created. [ 843.309233] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.309466] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.309538] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.309838] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.310167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.310419] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-1f8107c7-14fb-4465-ae7b-e1665ba3838a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.010233] env[66364]: INFO networking_nsxv3.common.synchronization [req-d0ec4317-4288-42e6-9b90-a6b644cfa079 req-fba021d7-7607-4417-a70d-a92ed9409b91 service nova] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 844.010233] env[66364]: INFO networking_nsxv3.common.synchronization [req-d0ec4317-4288-42e6-9b90-a6b644cfa079 req-fba021d7-7607-4417-a70d-a92ed9409b91 service nova] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 844.010233] env[66364]: INFO networking_nsxv3.common.synchronization [req-d0ec4317-4288-42e6-9b90-a6b644cfa079 req-fba021d7-7607-4417-a70d-a92ed9409b91 service nova] Enqueued Resource ID: 1f8107c7-14fb-4465-ae7b-e1665ba3838a with Priority: HIGHEST for action port [ 844.010233] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 844.010233] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 844.010233] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8107c7-14fb-4465-ae7b-e1665ba3838a with Priority: HIGHEST for action port [ 844.012456] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.012782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.013030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.013485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.013685] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.015555] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.016178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.016178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.016883] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.017689] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.017689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.017689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.017689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.017689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.017957] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.019050] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f8107c7-14fb-4465-ae7b-e1665ba3838a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.019471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f8107c7-14fb-4465-ae7b-e1665ba3838a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.019471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f8107c7-14fb-4465-ae7b-e1665ba3838a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.020309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f8107c7-14fb-4465-ae7b-e1665ba3838a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.020309] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f8107c7-14fb-4465-ae7b-e1665ba3838a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.025557] env[66364]: INFO networking_nsxv3.common.synchronization [req-e1768ddc-b5f5-4f47-8170-1771705041a4 req-7e70fb90-833b-4f25-b0aa-85be626cd932 tempest-ServerExternalEventsTest-364789271 tempest-ServerExternalEventsTest-364789271-project-member] Enqueued Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGHEST for action security_group_members [ 844.026929] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGHEST for action security_group_members [ 844.028577] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a79a858-0e03-4c0f-8127-6d5008465f85 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.028941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.029140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.029516] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.029764] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.029973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.030144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.030387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.030971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.030971] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a79a858-0e03-4c0f-8127-6d5008465f85',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.033554] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 665d57cc-5dea-494f-b1df-651330cfd64a in Status: SUCCESS [ 844.034165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.035077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.035837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.035837] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.035837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.035837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.038449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.038449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.038449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.038449] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.370979] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: SUCCESS [ 844.371347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.524160] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.524567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.524998] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.527138] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f8107c7-14fb-4465-ae7b-e1665ba3838a with status ACTIVE [ 844.527138] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.527526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.527526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.527526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.527728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.528296] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.528296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.528296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.528296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.528622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.528622] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.528622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.528622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.529098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.529098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.529098] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f8107c7-14fb-4465-ae7b-e1665ba3838a is going to be updated. [ 844.534290] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.534457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.534457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.534705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.534838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.539027] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.539027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.539027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.539027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.539027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.539027] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 is going to be updated. [ 844.539027] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.561055] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.562180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.562180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.562300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.562463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.562744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f8107c7-14fb-4465-ae7b-e1665ba3838a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.579531] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.580172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.580172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.580492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.580492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.591493] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 in Status: IN_PROGRESS for 2s [ 845.027973] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.042679] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 665d57cc-5dea-494f-b1df-651330cfd64a: rpc.has_security_group_logging(os_id): False [ 845.063478] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.063478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.063478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.063701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.063791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.064107] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.064279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.064389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.064540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.064618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.064705] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 665d57cc-5dea-494f-b1df-651330cfd64a is going to be created. [ 845.126617] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.126802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.126846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.127050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.127336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.139623] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 665d57cc-5dea-494f-b1df-651330cfd64a in Status: IN_PROGRESS for 2s [ 845.530535] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.530725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.530769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.530976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.531081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.531199] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be created. [ 845.556020] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.556147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.556234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.556431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.556624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.567195] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: UNINITIALIZED for 2s [ 846.605027] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 in Status: SUCCESS [ 846.605027] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 deletion is rescheduled due to dependency. [ 846.605027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.152062] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 665d57cc-5dea-494f-b1df-651330cfd64a in Status: SUCCESS [ 847.152375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.578849] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 847.579444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.579444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.579660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.579782] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.579904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.579967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.580164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.580260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.580345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.580458] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.084361] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.586944] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5028084e-cee8-4d90-822e-92c0b2a9224a: rpc.has_security_group_logging(os_id): False [ 848.616910] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.617174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.617174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.617466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.617504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.618142] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.618142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.618142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.618142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.618450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.618450] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be created. [ 848.719392] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.719619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.719729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.719939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.720164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.735127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: IN_PROGRESS for 2s [ 849.029123] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 849.029123] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 850.749096] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 850.749428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.904680] env[66364]: INFO networking_nsxv3.common.synchronization [req-2ec9fe23-db2c-49b0-9411-25bf1b973ff9 req-a162f6cf-cf1f-4a99-a687-80d5d8df20c7 tempest-ServersAdminTestJSON-1239172367 tempest-ServersAdminTestJSON-1239172367-project-member] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 851.905437] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 851.905717] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.905920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.906046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.906341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.906621] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.906744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.906842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.907097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.907220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.907349] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.410948] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.914714] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.416613] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.416787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.416857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.417107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.417204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.418034] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 853.428737] env[66364]: INFO networking_nsxv3.common.synchronization [req-f04f1d91-75d0-4bdc-8100-d76bae14990e req-14d7f623-37b8-4184-b9e3-2414b17b9e8b tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 853.429321] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 853.429640] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.429799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.429866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.430114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.430274] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.430416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.430475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.430573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.430687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.430751] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.458961] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.459082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.459127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.459384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.459562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.470395] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 853.785818] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.786036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.786121] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.786531] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.786805] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.787945] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.787945] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.787945] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.787945] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.787945] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.787945] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.787945] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.788207] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.788207] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.788207] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.788323] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.812739] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.813070] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.813070] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.813294] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.813623] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-15b87f4f-b628-4003-b436-fb1641277539 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.813795] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-15b87f4f-b628-4003-b436-fb1641277539" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.813921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-15b87f4f-b628-4003-b436-fb1641277539" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.814328] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-15b87f4f-b628-4003-b436-fb1641277539" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.814531] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b87f4f-b628-4003-b436-fb1641277539',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.888978] env[66364]: INFO networking_nsxv3.common.synchronization [req-5da801ec-75f9-40af-9ff6-04076f2cf295 req-bb994e58-97e9-4e1b-97a6-5c03409780dd tempest-ListServerFiltersTestJSON-936474167 tempest-ListServerFiltersTestJSON-936474167-project-member] Enqueued Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 853.889562] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 with Priority: HIGHEST for action security_group_members [ 853.889928] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b563fa6-e694-4628-a9da-1beb0ee48864 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.890070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.890142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.890332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.890482] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.890575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.890632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.890789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.890899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.890991] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b563fa6-e694-4628-a9da-1beb0ee48864',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.934451] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.934848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.934848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.934982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.937080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.937080] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.937080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.937080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.937080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.937080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.937080] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 already deleted. [ 853.937080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.319081] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.319305] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.319430] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.319776] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.319965] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.320135] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 15b87f4f-b628-4003-b436-fb1641277539 not found, creating... [ 854.320533] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.320663] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.320834] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.321118] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.321276] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.321581] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.321745] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.321871] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.322113] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.322247] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.322425] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 15b87f4f-b628-4003-b436-fb1641277539 is going to be created. [ 854.355167] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.355409] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.355488] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.355765] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.355993] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.356233] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-15b87f4f-b628-4003-b436-fb1641277539" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.393332] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.393747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.393949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.394456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.421360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.421663] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.421801] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.421954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.422518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.422610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.422716] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 is going to be updated. [ 854.477015] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.477196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.477196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.477478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.477641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.493694] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: IN_PROGRESS for 2s [ 854.792993] env[66364]: INFO networking_nsxv3.common.synchronization [req-f9c1ca82-16e0-4284-9ba7-63a7fd9f04ea req-5c8565b2-d09e-4523-864a-8ef38decbe27 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 854.793266] env[66364]: INFO networking_nsxv3.common.synchronization [req-f9c1ca82-16e0-4284-9ba7-63a7fd9f04ea req-5c8565b2-d09e-4523-864a-8ef38decbe27 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 5f27be25-ed4b-44e7-acca-a294df449bda with Priority: HIGHEST for action security_group_members [ 854.794143] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 854.794143] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f27be25-ed4b-44e7-acca-a294df449bda with Priority: HIGHEST for action security_group_members [ 854.794310] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.794498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.794563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.794763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.794917] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.795031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.795090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.795233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.795318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.795407] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.796385] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f27be25-ed4b-44e7-acca-a294df449bda taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.796385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.796544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.796615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.796752] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.796901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.796901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.797043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.797122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.797208] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f27be25-ed4b-44e7-acca-a294df449bda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.842295] env[66364]: INFO networking_nsxv3.common.synchronization [req-f9c1ca82-16e0-4284-9ba7-63a7fd9f04ea req-5c8565b2-d09e-4523-864a-8ef38decbe27 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 5f27be25-ed4b-44e7-acca-a294df449bda with Priority: HIGHEST for action security_group_rules [ 854.842435] env[66364]: INFO networking_nsxv3.common.synchronization [req-f9c1ca82-16e0-4284-9ba7-63a7fd9f04ea req-5c8565b2-d09e-4523-864a-8ef38decbe27 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 5f27be25-ed4b-44e7-acca-a294df449bda with Priority: HIGHEST for action security_group_members [ 854.842906] env[66364]: INFO networking_nsxv3.common.synchronization [req-f9c1ca82-16e0-4284-9ba7-63a7fd9f04ea req-5c8565b2-d09e-4523-864a-8ef38decbe27 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_rules [ 854.843065] env[66364]: INFO networking_nsxv3.common.synchronization [req-f9c1ca82-16e0-4284-9ba7-63a7fd9f04ea req-5c8565b2-d09e-4523-864a-8ef38decbe27 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 854.843210] env[66364]: INFO networking_nsxv3.common.synchronization [req-f9c1ca82-16e0-4284-9ba7-63a7fd9f04ea req-5c8565b2-d09e-4523-864a-8ef38decbe27 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 with Priority: HIGHEST for action port [ 854.843711] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f27be25-ed4b-44e7-acca-a294df449bda with Priority: HIGHEST for action security_group_rules [ 854.843840] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_rules [ 854.843930] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 with Priority: HIGHEST for action port [ 854.844083] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f27be25-ed4b-44e7-acca-a294df449bda with Priority: HIGHEST for action security_group_members [ 854.844208] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 854.844522] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f27be25-ed4b-44e7-acca-a294df449bda taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.844732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.844732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.844961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.845051] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f27be25-ed4b-44e7-acca-a294df449bda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.846205] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.846377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.846377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.846726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.846726] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.848066] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.848180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.848230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.848392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.848468] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce9c8a49-0dba-42cc-83d9-35c60c06c4f3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.849532] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f27be25-ed4b-44e7-acca-a294df449bda taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.849676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.850238] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.850238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.060132] env[66364]: INFO networking_nsxv3.common.synchronization [req-f04f1d91-75d0-4bdc-8100-d76bae14990e req-a6479ee0-307f-4072-a26b-457d6babc458 service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 855.060410] env[66364]: INFO networking_nsxv3.common.synchronization [req-f04f1d91-75d0-4bdc-8100-d76bae14990e req-a6479ee0-307f-4072-a26b-457d6babc458 service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 855.060459] env[66364]: INFO networking_nsxv3.common.synchronization [req-f04f1d91-75d0-4bdc-8100-d76bae14990e req-a6479ee0-307f-4072-a26b-457d6babc458 service nova] Enqueued Resource ID: 15b87f4f-b628-4003-b436-fb1641277539 with Priority: HIGHEST for action port [ 855.060909] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 855.061295] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 855.061446] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b87f4f-b628-4003-b436-fb1641277539 with Priority: HIGHEST for action port [ 855.061725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.061846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.061912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.062206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.062293] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.063298] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.063433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.063515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.063692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.063841] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.063936] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.064134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.064300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.064385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.064469] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.065452] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-15b87f4f-b628-4003-b436-fb1641277539 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.065578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15b87f4f-b628-4003-b436-fb1641277539" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.065638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15b87f4f-b628-4003-b436-fb1641277539" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.065834] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15b87f4f-b628-4003-b436-fb1641277539" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.065953] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b87f4f-b628-4003-b436-fb1641277539',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.135349] env[66364]: INFO networking_nsxv3.common.synchronization [req-c90c2c98-f72d-4654-ad1e-72010e4ec8f2 req-8b11d0c6-9991-4950-8976-c4d66ee962a9 tempest-ImagesOneServerTestJSON-1626765433 tempest-ImagesOneServerTestJSON-1626765433-project-member] Enqueued Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGHEST for action security_group_members [ 855.136131] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGHEST for action security_group_members [ 855.136468] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d9f4a86-c2b4-40ed-8c1d-651067e33449 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.136848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.136921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.137187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.137347] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.137448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.137503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.137669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.137754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.137847] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d9f4a86-c2b4-40ed-8c1d-651067e33449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.299614] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.301427] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f27be25-ed4b-44e7-acca-a294df449bda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.348484] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.348812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.349999] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 with status ACTIVE [ 855.350229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.350349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.350416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.350630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.350723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.350904] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.351010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.351187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.351314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.351367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.351526] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.351684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.351735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.351913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.351952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.352030] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 is going to be updated. [ 855.353165] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f27be25-ed4b-44e7-acca-a294df449bda taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.353314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.374476] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.374629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.374691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.374903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.375059] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.375220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.445047] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba4623d3-6d35-4d2c-9ac5-006fac492a5f req-eed633b8-c6b3-43f2-b9c5-ff91288f51a7 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 855.445047] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba4623d3-6d35-4d2c-9ac5-006fac492a5f req-eed633b8-c6b3-43f2-b9c5-ff91288f51a7 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 5f27be25-ed4b-44e7-acca-a294df449bda with Priority: HIGHEST for action security_group_members [ 855.445863] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 855.445913] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f27be25-ed4b-44e7-acca-a294df449bda with Priority: HIGHEST for action security_group_members [ 855.446340] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.446447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.447079] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f27be25-ed4b-44e7-acca-a294df449bda taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.447180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.480662] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 855.480892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.492364] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba4623d3-6d35-4d2c-9ac5-006fac492a5f req-eed633b8-c6b3-43f2-b9c5-ff91288f51a7 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_rules [ 855.492540] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba4623d3-6d35-4d2c-9ac5-006fac492a5f req-eed633b8-c6b3-43f2-b9c5-ff91288f51a7 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 855.492678] env[66364]: INFO networking_nsxv3.common.synchronization [req-ba4623d3-6d35-4d2c-9ac5-006fac492a5f req-eed633b8-c6b3-43f2-b9c5-ff91288f51a7 tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 with Priority: HIGHEST for action port [ 855.493223] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_rules [ 855.493370] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 855.493472] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 with Priority: HIGHEST for action port [ 855.493744] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.493846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.494075] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.494303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.494462] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.494559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.494622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.494835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.494884] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce9c8a49-0dba-42cc-83d9-35c60c06c4f3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.572159] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.574040] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.574197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.574820] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15b87f4f-b628-4003-b436-fb1641277539 with status ACTIVE [ 855.574820] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.574820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.575016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.575118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.575181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.575389] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.575448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.575483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.575656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.575767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.575938] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.576650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.576650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.576650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.576650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.576650] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15b87f4f-b628-4003-b436-fb1641277539 is going to be updated. [ 855.601529] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.601726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.601726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.602284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.602284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.602284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15b87f4f-b628-4003-b436-fb1641277539" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.640495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.640495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.640495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.640811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.640811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.640907] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.640994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.641077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.641376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.641529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.641598] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 is going to be updated. [ 855.669318] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.669469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.669547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.669755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.670164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.679653] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 in Status: IN_PROGRESS for 2s [ 855.802829] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.803925] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f27be25-ed4b-44e7-acca-a294df449bda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.997670] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 with status ACTIVE [ 855.997670] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.998241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.998241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.998327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.998439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.998714] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.998881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.998978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.999260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.999425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.999693] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.999854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.999956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.000196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.000311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.000452] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce9c8a49-0dba-42cc-83d9-35c60c06c4f3 is going to be updated. [ 856.022360] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.022528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.022583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.022854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.022956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.023104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce9c8a49-0dba-42cc-83d9-35c60c06c4f3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.075692] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.306176] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.306537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.306537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.306815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.306972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.307152] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd is going to be updated. [ 856.309657] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.309814] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.310021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.310175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.310315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.310467] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f27be25-ed4b-44e7-acca-a294df449bda is going to be created. [ 856.355183] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.355348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.355581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.355659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.355794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.366170] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.366374] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.366374] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.366750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.366750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.372466] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f27be25-ed4b-44e7-acca-a294df449bda in Status: UNINITIALIZED for 2s [ 856.381597] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: IN_PROGRESS for 2s [ 856.514608] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 in Status: SUCCESS [ 856.514804] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b563fa6-e694-4628-a9da-1beb0ee48864 deletion is rescheduled due to dependency. [ 856.514925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b563fa6-e694-4628-a9da-1beb0ee48864" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.578167] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.578474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.578595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.578869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.578963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.579076] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be created. [ 856.603125] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.603449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.603449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.603577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.603735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.615068] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: UNINITIALIZED for 2s [ 857.693272] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 in Status: SUCCESS [ 857.693609] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 deletion is rescheduled due to dependency. [ 857.693609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.098363] env[66364]: INFO networking_nsxv3.common.synchronization [req-981e5154-1122-4334-8ed6-b3aed149476e req-e5b2a2bc-f472-4c7f-9c10-6abd4e8e3b62 tempest-ServersAdminNegativeTestJSON-1819478050 tempest-ServersAdminNegativeTestJSON-1819478050-project-member] Enqueued Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 858.098898] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 007f96f6-a408-4a76-b5c6-eceae8238916 with Priority: HIGHEST for action security_group_members [ 858.099680] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-007f96f6-a408-4a76-b5c6-eceae8238916 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.099858] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.099966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.100216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.100381] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.100484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.100548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.100699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.100817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.100913] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('007f96f6-a408-4a76-b5c6-eceae8238916',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.386689] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f27be25-ed4b-44e7-acca-a294df449bda in Status: SUCCESS [ 858.386937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.387853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.388144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.388343] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.388478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.388529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.388779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.388779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.388905] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f27be25-ed4b-44e7-acca-a294df449bda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.396746] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: SUCCESS [ 858.396866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.397056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.397257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.397405] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.397544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.397601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.397837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.397980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.397980] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.603301] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.603498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.603570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.603795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.603909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.604106] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.604228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.604292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.604422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.604499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.604581] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007f96f6-a408-4a76-b5c6-eceae8238916 is going to be updated. [ 858.627177] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 858.628581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.628722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.628919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.629177] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.629333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.629406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.629615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.629710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.629854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.629921] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.638479] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.638479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.638479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.638479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.638479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.650404] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: IN_PROGRESS for 2s [ 858.890768] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.891125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.891125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.891298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.891403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.891607] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.891708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.891766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.891925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.892021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.892097] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f27be25-ed4b-44e7-acca-a294df449bda is going to be deleted. [ 858.900514] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.927175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.927350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.927403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.928119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.928119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.928119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.928397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.928590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.928993] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.929121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.929209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.929329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.929409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.929499] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f27be25-ed4b-44e7-acca-a294df449bda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.135019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.135019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.135019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.135019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.135019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.135894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.135894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.135894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.135894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.135894] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.403058] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.432336] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.432336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.432336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.432336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.432661] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.432661] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.432788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.432846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.433016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.433092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.433173] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f27be25-ed4b-44e7-acca-a294df449bda already deleted. [ 859.433321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.433430] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f27be25-ed4b-44e7-acca-a294df449bda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.434325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.434488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.434644] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.434751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.435428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.435428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.435428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.435428] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f27be25-ed4b-44e7-acca-a294df449bda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.637049] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e327b378-51f2-4bc5-8b1c-697b0302c4a5: rpc.has_security_group_logging(os_id): False [ 859.658061] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.658291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.658373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.658597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.658717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.658940] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.659071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.659170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.659373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.659466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.663041] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.663041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.663041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.663041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.663041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.663041] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.663041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.663041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.663041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.663041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.663041] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be created. [ 859.726357] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.726503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.726567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.726783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.726964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.738896] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 859.907580] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.908061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.908061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.908189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.908232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.908319] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd is going to be updated. [ 859.937468] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f27be25-ed4b-44e7-acca-a294df449bda',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.939931] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.939931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.939931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.939931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.939931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.940311] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.940311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.940403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.940654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.940783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.940899] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f27be25-ed4b-44e7-acca-a294df449bda already deleted. [ 859.941066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.942376] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.942523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.942637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.942880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.943094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.954094] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: IN_PROGRESS for 2s [ 860.447038] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f27be25-ed4b-44e7-acca-a294df449bda: rpc.has_security_group_logging(os_id): False [ 860.469303] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.469518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.469518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.469681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.469775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.469991] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.470103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.470169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.470326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.470403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.470491] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f27be25-ed4b-44e7-acca-a294df449bda is going to be created. [ 860.488266] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5f27be25-ed4b-44e7-acca-a294df449bda], does not exist path=[/infra/domains/default/groups/5f27be25-ed4b-44e7-acca-a294df449bda]."\n}' [ 860.488468] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f27be25-ed4b-44e7-acca-a294df449bda failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5f27be25-ed4b-44e7-acca-a294df449bda [ 860.488517] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 860.534230] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.534412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.534412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.534703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.535681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.536019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.536140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.536200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.536394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.536477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.536655] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.536747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.536807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.537279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.537279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.537279] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f27be25-ed4b-44e7-acca-a294df449bda is going to be created. [ 860.560433] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5f27be25-ed4b-44e7-acca-a294df449bda], does not exist path=[/infra/domains/default/groups/5f27be25-ed4b-44e7-acca-a294df449bda]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5f27be25-ed4b-44e7-acca-a294df449bda [ 860.560433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f27be25-ed4b-44e7-acca-a294df449bda" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.560433] env[66364]: Traceback (most recent call last): [ 860.560433] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 860.560433] env[66364]: return func(*args, **kwargs) [ 860.560433] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 860.560433] env[66364]: res.raise_for_status() [ 860.560433] env[66364]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 860.560433] env[66364]: raise HTTPError(http_error_msg, response=self) [ 860.560433] env[66364]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5f27be25-ed4b-44e7-acca-a294df449bda [ 860.560433] env[66364]: During handling of the above exception, another exception occurred: [ 860.560433] env[66364]: Traceback (most recent call last): [ 860.560433] env[66364]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 860.560433] env[66364]: listener.cb(fileno) [ 860.560433] env[66364]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 860.560433] env[66364]: result = function(*args, **kwargs) [ 860.560433] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 860.560433] env[66364]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 860.560433] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 860.560433] env[66364]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 860.560433] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 860.560433] env[66364]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 860.560433] env[66364]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 860.560433] env[66364]: res.raise_for_status() [ 860.560433] env[66364]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 860.560433] env[66364]: raise HTTPError(http_error_msg, response=self) [ 860.560433] env[66364]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5f27be25-ed4b-44e7-acca-a294df449bda [ 860.560433] env[66364]: Removing descriptor: 19 [ 860.660501] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 007f96f6-a408-4a76-b5c6-eceae8238916 in Status: SUCCESS [ 860.661697] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 007f96f6-a408-4a76-b5c6-eceae8238916 deletion is rescheduled due to dependency. [ 860.661697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-007f96f6-a408-4a76-b5c6-eceae8238916" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.568570] env[66364]: INFO networking_nsxv3.common.synchronization [req-f04258e7-6659-4d26-af33-179ea2bba1e1 req-7ac4a4bc-54b3-4417-8b07-40855e0c185e tempest-ServerRescueTestJSONUnderV235-340949520 tempest-ServerRescueTestJSONUnderV235-340949520-project-member] Enqueued Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 861.569316] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92790af5-7562-4576-af5a-785b171701bd with Priority: HIGHEST for action security_group_members [ 861.569724] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.569864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.755645] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 861.756162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.964696] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: SUCCESS [ 861.964963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.965167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.965440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.965685] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.965834] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.965908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.966125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.966216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.966329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.966437] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.967396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.967791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.967992] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.968139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.968205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.968381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.968486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.968584] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.470841] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.471034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.471266] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.471374] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.471438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.471647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.495075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.495351] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.495547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.495611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.496268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.496268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.496268] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd is going to be updated. [ 862.537480] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.537724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.537835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.538113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.538276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.548314] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: IN_PROGRESS for 2s [ 864.562339] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: SUCCESS [ 864.562653] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd deletion is rescheduled due to dependency. [ 864.562653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.562783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.563033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.563226] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.563389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.563460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.563583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.563665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.563759] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.066397] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.067029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.067029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.067029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.067029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.067248] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.067248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.067364] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.067403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.067480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.067569] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd is going to be updated. [ 865.093440] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.093699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.093763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.093975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.094440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.103769] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: IN_PROGRESS for 2s [ 866.023602] env[66364]: INFO networking_nsxv3.common.synchronization [req-33f38282-38a3-492b-be4b-09e8afbb3447 req-fa921dd5-5d37-401f-8678-734debe0f744 tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 866.024200] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 866.024508] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.024652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.024729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.024889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.025104] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.025192] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.025242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.025364] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.025450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.025543] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.185138] env[66364]: INFO networking_nsxv3.common.synchronization [req-40ba2532-0190-4472-af1d-853b78a91dfd req-c4cee1dc-a328-493f-a11a-8698a35341ce tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 866.185670] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 866.185973] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.186119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.186183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.186380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.186533] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.186627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.186690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.186833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.186915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.187015] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.528116] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.528116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.528291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.528439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.552414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.552414] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.552414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.552414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.552414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.552414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.552414] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 866.583020] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.583020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.583020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.583020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.583020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.593313] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 866.595346] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-501 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.595535] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.595700] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.596203] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.596496] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.597288] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.597475] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.597735] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.597882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.598175] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.598295] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.598407] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.598513] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.598624] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.598728] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.598866] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.620783] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.621013] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.621168] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.621366] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.621786] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-81f6f082-6ace-4731-967e-2b45fbada248 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.621970] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-81f6f082-6ace-4731-967e-2b45fbada248" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.622099] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-81f6f082-6ace-4731-967e-2b45fbada248" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.622416] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-81f6f082-6ace-4731-967e-2b45fbada248" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.622552] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81f6f082-6ace-4731-967e-2b45fbada248',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.688854] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.117071] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: SUCCESS [ 867.117343] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd deletion is rescheduled due to dependency. [ 867.117343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.117500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.118058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.118058] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.118406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.118406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.118406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.118406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.118613] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.125454] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.125847] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.126120] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.126474] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.126611] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.126766] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 81f6f082-6ace-4731-967e-2b45fbada248 not found, creating... [ 867.127048] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.127213] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.127330] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.127586] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.127723] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.128009] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.128170] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.128283] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.128538] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.128658] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.128825] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 81f6f082-6ace-4731-967e-2b45fbada248 is going to be created. [ 867.151350] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.151350] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.152287] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.152628] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.152898] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.153161] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-81f6f082-6ace-4731-967e-2b45fbada248" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.190982] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.622959] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.623266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.623489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.623867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.624060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.624391] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.624573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.624693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.624989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.625120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.625270] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd is going to be updated. [ 867.652231] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.652453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.652453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.652652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.652793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.662052] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: IN_PROGRESS for 2s [ 867.693704] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.693853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.693914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.694237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.694340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.694456] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 867.728136] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.728326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.728410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.728664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.728869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.737401] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 867.864921] env[66364]: INFO networking_nsxv3.common.synchronization [req-40ba2532-0190-4472-af1d-853b78a91dfd req-978a53c2-f897-4a7f-9279-364d94d569e8 service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 867.865140] env[66364]: INFO networking_nsxv3.common.synchronization [req-40ba2532-0190-4472-af1d-853b78a91dfd req-978a53c2-f897-4a7f-9279-364d94d569e8 service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 867.865281] env[66364]: INFO networking_nsxv3.common.synchronization [req-40ba2532-0190-4472-af1d-853b78a91dfd req-978a53c2-f897-4a7f-9279-364d94d569e8 service nova] Enqueued Resource ID: 81f6f082-6ace-4731-967e-2b45fbada248 with Priority: HIGHEST for action port [ 867.865837] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 867.866094] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 867.866198] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81f6f082-6ace-4731-967e-2b45fbada248 with Priority: HIGHEST for action port [ 867.866482] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.866640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.866726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.866851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.866930] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.908359] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.908359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.908359] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-81f6f082-6ace-4731-967e-2b45fbada248 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.908359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81f6f082-6ace-4731-967e-2b45fbada248" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.908359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81f6f082-6ace-4731-967e-2b45fbada248" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.908359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81f6f082-6ace-4731-967e-2b45fbada248" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.908359] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81f6f082-6ace-4731-967e-2b45fbada248',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.370760] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.371236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.372255] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81f6f082-6ace-4731-967e-2b45fbada248 with status ACTIVE [ 868.372487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.372705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.372705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.372969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.373084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.373270] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.373420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.373485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.373666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.373952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.374307] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.374435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.374504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.374656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.374734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.374818] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81f6f082-6ace-4731-967e-2b45fbada248 is going to be updated. [ 868.399546] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.399546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.399546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.399837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.399965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.400117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81f6f082-6ace-4731-967e-2b45fbada248" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.609069] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 868.609270] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 868.609387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.828685] env[66364]: INFO networking_nsxv3.common.synchronization [req-e578d241-3f55-4428-a5d4-4de4ca0768e1 req-51995013-fc06-41aa-b737-d2bac35d1c31 tempest-ServerActionsTestOtherB-1668111998 tempest-ServerActionsTestOtherB-1668111998-project-member] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 868.829111] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 868.829436] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.829559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.831077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.831077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.831077] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.831077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.831077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.831077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.831077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.831077] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.156413] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.156607] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.156727] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.157085] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.157350] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.157502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.157613] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.157825] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.157967] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.158175] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.158285] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.158390] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.158495] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.158602] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.158729] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.158867] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.183263] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.183263] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.183263] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.183263] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.183567] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-41bb0258-2f2a-4f22-8014-a99cf9b609ad taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.183747] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-41bb0258-2f2a-4f22-8014-a99cf9b609ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.183902] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-41bb0258-2f2a-4f22-8014-a99cf9b609ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.184234] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-41bb0258-2f2a-4f22-8014-a99cf9b609ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.184375] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41bb0258-2f2a-4f22-8014-a99cf9b609ad',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.336019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.336019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.336019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.336019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.336019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.336019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.336019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.336019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.336019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.336019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.336019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 already deleted. [ 869.336019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.672282] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: SUCCESS [ 869.672611] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92790af5-7562-4576-af5a-785b171701bd deletion is rescheduled due to dependency. [ 869.672611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.672757] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.672973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.673186] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.673302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.673379] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.673547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.673627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.673709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.673864] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-92790af5-7562-4576-af5a-785b171701bd taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.673957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.674025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.674166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.674317] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.674457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.674500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.674607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.674677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.674753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.674842] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.687995] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.688216] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.688830] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.688830] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.688830] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.688830] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 41bb0258-2f2a-4f22-8014-a99cf9b609ad not found, creating... [ 869.689088] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.689235] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.689343] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.689546] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.689670] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.691097] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.691097] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.691097] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.691097] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.691097] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.691097] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 41bb0258-2f2a-4f22-8014-a99cf9b609ad is going to be created. [ 869.712073] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.712290] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.712435] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.712735] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.712967] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.713208] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-41bb0258-2f2a-4f22-8014-a99cf9b609ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.756952] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 869.758058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.758058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.758058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.758058] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.758300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.758300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.758348] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.758444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.758539] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.177411] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92790af5-7562-4576-af5a-785b171701bd: rpc.has_security_group_logging(os_id): False [ 870.197517] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.197678] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.197678] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.197884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.197976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.198170] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.198265] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.198326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.198496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.198623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.198845] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.198845] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.198992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.199038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.199115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.199305] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.199403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.199475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.199618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.199690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.199773] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92790af5-7562-4576-af5a-785b171701bd is going to be updated. [ 870.260865] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.262806] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.262976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.263040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.263884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.263884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.276809] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: IN_PROGRESS for 2s [ 870.408671] env[66364]: INFO networking_nsxv3.common.synchronization [req-e578d241-3f55-4428-a5d4-4de4ca0768e1 req-19182209-e835-465f-9a91-d163438c1a7a service nova] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 870.408972] env[66364]: INFO networking_nsxv3.common.synchronization [req-e578d241-3f55-4428-a5d4-4de4ca0768e1 req-19182209-e835-465f-9a91-d163438c1a7a service nova] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 870.410456] env[66364]: INFO networking_nsxv3.common.synchronization [req-e578d241-3f55-4428-a5d4-4de4ca0768e1 req-19182209-e835-465f-9a91-d163438c1a7a service nova] Enqueued Resource ID: 41bb0258-2f2a-4f22-8014-a99cf9b609ad with Priority: HIGHEST for action port [ 870.411900] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 870.412129] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 870.412280] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41bb0258-2f2a-4f22-8014-a99cf9b609ad with Priority: HIGHEST for action port [ 870.412702] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.412886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.412982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.413339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.413420] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.416471] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.416748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.416855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.417125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.417340] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.417474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.417558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.417747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.417859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.417984] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.419695] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-41bb0258-2f2a-4f22-8014-a99cf9b609ad taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.419821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41bb0258-2f2a-4f22-8014-a99cf9b609ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.419890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41bb0258-2f2a-4f22-8014-a99cf9b609ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.420406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41bb0258-2f2a-4f22-8014-a99cf9b609ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.420406] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41bb0258-2f2a-4f22-8014-a99cf9b609ad',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.766224] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.925522] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.926678] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.926788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.926952] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41bb0258-2f2a-4f22-8014-a99cf9b609ad with status ACTIVE [ 870.927123] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.927227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.927296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.927503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.927594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.927758] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.927868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.927908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.928187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.928269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.928453] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.928557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.928616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.928759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.928832] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.929142] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41bb0258-2f2a-4f22-8014-a99cf9b609ad is going to be updated. [ 870.953643] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.953783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.953856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.954058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.954196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.954365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41bb0258-2f2a-4f22-8014-a99cf9b609ad" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.270022] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.270022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.270022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.270022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.270022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.270022] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 871.297890] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.298149] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.298149] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.298346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.298496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.310032] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 871.341707] env[66364]: INFO networking_nsxv3.common.synchronization [req-2b41d027-f1e3-47b4-82de-db3e67d4cf9c req-bfb1943b-3a80-400f-8baa-1848e63c4145 tempest-ServerAddressesNegativeTestJSON-1266249142 tempest-ServerAddressesNegativeTestJSON-1266249142-project-member] Enqueued Resource ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 with Priority: HIGHEST for action security_group_members [ 871.345047] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 with Priority: HIGHEST for action security_group_members [ 871.345047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.345047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.345047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.345047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.345047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.345047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.345047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.345047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.345047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.345047] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a80c29ba-9fac-4002-9bc5-2c6f28eafc86',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.431130] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.726173] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.726377] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-578" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.726499] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-578" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.726824] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-578" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.727094] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.727253] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.727365] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.727882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.727882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.727966] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.728076] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.728186] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.728292] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.728398] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.728500] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.728627] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.748245] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.748420] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.748563] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.748773] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-578" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.749199] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-5f26512c-fef4-43a8-be07-d29768478a5d taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.749272] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-5f26512c-fef4-43a8-be07-d29768478a5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.749337] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-5f26512c-fef4-43a8-be07-d29768478a5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.749676] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-5f26512c-fef4-43a8-be07-d29768478a5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.749816] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f26512c-fef4-43a8-be07-d29768478a5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.848323] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.848640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.848640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.848846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.848924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.849142] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.849245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.849310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.849471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.849548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.849631] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 already deleted. [ 871.849763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.934319] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.934493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.934566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.934788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.934878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.935037] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be created. [ 871.959866] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.960117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.960117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.960382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.960459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.971127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: UNINITIALIZED for 2s [ 872.251964] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.252212] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.252336] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.252637] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.252773] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.252925] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 5f26512c-fef4-43a8-be07-d29768478a5d not found, creating... [ 872.253218] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.253407] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.253531] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.253782] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.253918] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.254225] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.254396] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.254526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.254749] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.254879] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.255037] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 5f26512c-fef4-43a8-be07-d29768478a5d is going to be created. [ 872.286667] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.286948] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.287062] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.287321] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.287580] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.287791] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-5f26512c-fef4-43a8-be07-d29768478a5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.293813] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92790af5-7562-4576-af5a-785b171701bd in Status: SUCCESS [ 872.294058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.294223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.294495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.294562] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92790af5-7562-4576-af5a-785b171701bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.817783] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.817951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.818762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.818762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.818762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.818762] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92790af5-7562-4576-af5a-785b171701bd is going to be deleted. [ 872.883090] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.884734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.884734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.884734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.884734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.884734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92790af5-7562-4576-af5a-785b171701bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.042975] env[66364]: INFO networking_nsxv3.common.synchronization [req-2b41d027-f1e3-47b4-82de-db3e67d4cf9c req-ad4d9cda-95a1-4712-a0c7-a1ec42dafd16 service nova] Enqueued Resource ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 with Priority: HIGHEST for action security_group_rules [ 873.043407] env[66364]: INFO networking_nsxv3.common.synchronization [req-2b41d027-f1e3-47b4-82de-db3e67d4cf9c req-ad4d9cda-95a1-4712-a0c7-a1ec42dafd16 service nova] Enqueued Resource ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 with Priority: HIGHEST for action security_group_members [ 873.043407] env[66364]: INFO networking_nsxv3.common.synchronization [req-2b41d027-f1e3-47b4-82de-db3e67d4cf9c req-ad4d9cda-95a1-4712-a0c7-a1ec42dafd16 service nova] Enqueued Resource ID: 5f26512c-fef4-43a8-be07-d29768478a5d with Priority: HIGHEST for action port [ 873.043873] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 with Priority: HIGHEST for action security_group_rules [ 873.044023] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 with Priority: HIGHEST for action security_group_members [ 873.044205] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f26512c-fef4-43a8-be07-d29768478a5d with Priority: HIGHEST for action port [ 873.044446] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a80c29ba-9fac-4002-9bc5-2c6f28eafc86 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.044558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.044757] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.044887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.044970] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a80c29ba-9fac-4002-9bc5-2c6f28eafc86',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.045886] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.046040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.046077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.046261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.046421] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.046596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.046596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.046790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.046790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.046881] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a80c29ba-9fac-4002-9bc5-2c6f28eafc86',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.047741] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f26512c-fef4-43a8-be07-d29768478a5d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.047822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f26512c-fef4-43a8-be07-d29768478a5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.047914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f26512c-fef4-43a8-be07-d29768478a5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.048086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f26512c-fef4-43a8-be07-d29768478a5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.048163] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f26512c-fef4-43a8-be07-d29768478a5d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.323196] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 873.323196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.323196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.323196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.323196] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.323196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.323196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.323196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.323196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.324110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.324110] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.551016] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.551230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.552558] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a80c29ba-9fac-4002-9bc5-2c6f28eafc86',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.552603] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f26512c-fef4-43a8-be07-d29768478a5d with status ACTIVE [ 873.552782] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.552929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.553020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.553479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.553479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.553589] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.553667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.553667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.553828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.553925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.556190] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.556329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.556376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.556991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.556991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.556991] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f26512c-fef4-43a8-be07-d29768478a5d is going to be updated. [ 873.585229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.585584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.585584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.585671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.585806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.585969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f26512c-fef4-43a8-be07-d29768478a5d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.826698] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.826851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.826922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.828426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.828647] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.829683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.829918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.830158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.830373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.830510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.830720] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.832876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.833167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.833437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.833629] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.833773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.833820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.834014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.834106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.834178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.834282] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.967042] env[66364]: INFO networking_nsxv3.common.synchronization [req-295fdb2d-127b-4a82-93f9-3e7ee4ef29af req-0b8715de-a7c9-4b29-b050-3399274a264d tempest-ServersTestFqdnHostnames-2079979295 tempest-ServersTestFqdnHostnames-2079979295-project-member] Enqueued Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_members [ 873.967713] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_members [ 873.968166] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.968319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.968789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.968789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.968967] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.969085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.969164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.969665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.969665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.969665] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.982515] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 873.982883] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.982987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.983220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.983452] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.983577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.983639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.983805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.983878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.983967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.984069] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.059905] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a80c29ba-9fac-4002-9bc5-2c6f28eafc86',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.337643] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 784e3e36-fad9-4cd6-a173-77329b5f03c2: rpc.has_security_group_logging(os_id): False [ 874.359468] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.359672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.359755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.359924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.386855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.387150] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.387302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.387373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.387948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.387948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.387948] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.387948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.387948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.388183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.388183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.388715] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.388715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.388715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.388715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.388715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.388942] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 874.460567] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.460720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.460818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.461016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.461191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.472180] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.472455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.472455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.472654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.472739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.473016] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.473218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.473218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.476024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.476024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.476024] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 already deleted. [ 874.476024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.477028] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 874.486770] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.562103] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.562731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.562731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.562731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.562731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.562969] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 is going to be created. [ 874.605124] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.605302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.605377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.605547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.605702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.617031] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 in Status: UNINITIALIZED for 2s [ 874.626431] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-650 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.626633] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-650" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.626801] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-650" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.627208] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-650" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.627484] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.627921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.627921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.628059] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.628258] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.628476] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.628584] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.628772] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.628843] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.628889] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.628995] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.629162] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.647455] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.647682] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 874.647744] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.647917] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-650" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.648269] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-c02b9d8e-1167-4a73-b5c2-f676f012cc98 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.648636] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-c02b9d8e-1167-4a73-b5c2-f676f012cc98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.648636] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-c02b9d8e-1167-4a73-b5c2-f676f012cc98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.648952] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-c02b9d8e-1167-4a73-b5c2-f676f012cc98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.649115] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c02b9d8e-1167-4a73-b5c2-f676f012cc98',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.988727] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85f93bd5-5dca-472e-a30a-fd77d873bad8: rpc.has_security_group_logging(os_id): False [ 875.013960] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.014175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.014219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.014441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.014533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.014791] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.014918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.014993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.015175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.015251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.015339] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be created. [ 875.071604] env[66364]: INFO networking_nsxv3.common.synchronization [None req-d3f34eb1-a800-4c57-877b-1bbda48b9ad8 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_rules [ 875.071604] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_rules [ 875.071927] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6d923ea-108c-4ea6-b072-aa5974291da3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.072042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.072075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.073068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.073068] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.089726] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.089894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.089967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.090272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.090463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.103924] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 875.154196] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.154196] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.154196] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.154196] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.154196] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.154196] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port c02b9d8e-1167-4a73-b5c2-f676f012cc98 not found, creating... [ 875.154196] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.154566] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.154566] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.154921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.155085] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.155748] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.155748] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.155748] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.156020] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.156154] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.157539] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: c02b9d8e-1167-4a73-b5c2-f676f012cc98 is going to be created. [ 875.179277] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.179544] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.179746] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.180080] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.180335] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.180575] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-c02b9d8e-1167-4a73-b5c2-f676f012cc98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.600080] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.600339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.600461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.600815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.600954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.601189] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6d923ea-108c-4ea6-b072-aa5974291da3 already deleted. [ 875.601335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.028527] env[66364]: INFO networking_nsxv3.common.synchronization [req-295fdb2d-127b-4a82-93f9-3e7ee4ef29af req-26e1bc11-7f2f-4f96-b5c6-ad41b9dde2e6 service nova] Enqueued Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_rules [ 876.028527] env[66364]: INFO networking_nsxv3.common.synchronization [req-295fdb2d-127b-4a82-93f9-3e7ee4ef29af req-26e1bc11-7f2f-4f96-b5c6-ad41b9dde2e6 service nova] Enqueued Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_members [ 876.028527] env[66364]: INFO networking_nsxv3.common.synchronization [req-295fdb2d-127b-4a82-93f9-3e7ee4ef29af req-26e1bc11-7f2f-4f96-b5c6-ad41b9dde2e6 service nova] Enqueued Resource ID: c02b9d8e-1167-4a73-b5c2-f676f012cc98 with Priority: HIGHEST for action port [ 876.030485] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_rules [ 876.030885] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_members [ 876.031178] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c02b9d8e-1167-4a73-b5c2-f676f012cc98 with Priority: HIGHEST for action port [ 876.032019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.032370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.032578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.033256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.033482] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.035146] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.036256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.036256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.036256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.036256] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.037625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.037625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.037625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.037625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.037625] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.040619] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c02b9d8e-1167-4a73-b5c2-f676f012cc98 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.040619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c02b9d8e-1167-4a73-b5c2-f676f012cc98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.040762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c02b9d8e-1167-4a73-b5c2-f676f012cc98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.040965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c02b9d8e-1167-4a73-b5c2-f676f012cc98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.041951] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c02b9d8e-1167-4a73-b5c2-f676f012cc98',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.149574] env[66364]: INFO networking_nsxv3.common.synchronization [None req-da482a89-5459-41c2-b5ee-277de7e1ed73 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_rules [ 876.150142] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_rules [ 876.153271] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6d923ea-108c-4ea6-b072-aa5974291da3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.153271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.153271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.153271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.153271] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.492923] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 876.492923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.544583] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.544756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.544922] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.545920] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c02b9d8e-1167-4a73-b5c2-f676f012cc98 with status ACTIVE [ 876.546069] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.546193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.546261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.546482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.546591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.546826] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.547520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.547520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.547520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.547520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.547520] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.547520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.547812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.547812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.547812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.547893] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c02b9d8e-1167-4a73-b5c2-f676f012cc98 is going to be updated. [ 876.573035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.573035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.573035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.573035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.573035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.573035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c02b9d8e-1167-4a73-b5c2-f676f012cc98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.628871] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 in Status: SUCCESS [ 876.629119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.629304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.629676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.629937] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.630120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.630198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.630452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.630564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.630667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.630781] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a80c29ba-9fac-4002-9bc5-2c6f28eafc86',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.681915] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.681915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.681915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.682234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.682328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.682486] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6d923ea-108c-4ea6-b072-aa5974291da3 already deleted. [ 876.683119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.699629] env[66364]: INFO networking_nsxv3.common.synchronization [req-9847432a-a89a-4705-aa55-acdaa965ab42 req-db9da7fd-a8ba-4b87-8965-8ff7136ef47f tempest-ServerAddressesTestJSON-376661275 tempest-ServerAddressesTestJSON-376661275-project-member] Enqueued Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGHEST for action security_group_members [ 876.700660] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGHEST for action security_group_members [ 876.701065] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.701192] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.701306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.701743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.702206] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.702206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.702206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.702355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.702733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.702733] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.049654] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.120424] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 877.120424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.133796] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.134107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.134412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.134596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.134892] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.135086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.135187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.135452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.135551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.135682] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.135907] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.136065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.136154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.136507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.136589] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.136716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.136813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.137031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.137156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.137283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.137425] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a80c29ba-9fac-4002-9bc5-2c6f28eafc86',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.185090] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-629 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.185367] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-629" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.185574] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-629" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.185951] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-629" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.186247] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.186405] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.186542] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.187149] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.187350] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.187588] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.187706] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 877.187815] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 877.187923] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 877.188197] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 877.188366] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 877.188529] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 877.205235] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.205235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.205235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.205473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.205540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.205758] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.205895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.206051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.206102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.206166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.206734] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d already deleted. [ 877.206734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.212783] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 877.212991] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 877.213144] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 877.213318] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-629" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.213695] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.213864] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.213982] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.214309] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.214471] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28c36a1e-02ca-4aa9-8f17-295f0eb95ef9',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.552377] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.552579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.552673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.552895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.552988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.553098] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 is going to be created. [ 877.582629] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.582807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.582845] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.583081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.583249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.599456] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 in Status: UNINITIALIZED for 2s [ 877.640087] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a80c29ba-9fac-4002-9bc5-2c6f28eafc86: rpc.has_security_group_logging(os_id): False [ 877.660753] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.661018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.661086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.661338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.661472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.661708] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.661838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.661909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.662107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.662180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.662386] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.662482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.662541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.662707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.662857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.662942] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.663042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.663101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.663241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.663314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.663427] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 is going to be created. [ 877.717340] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.717663] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.717879] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.718208] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.718481] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.718727] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 28c36a1e-02ca-4aa9-8f17-295f0eb95ef9 not found, creating... [ 877.719293] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.719485] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.719609] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.719976] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.720340] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.720716] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.720966] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.721151] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.721572] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.721984] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.722078] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 28c36a1e-02ca-4aa9-8f17-295f0eb95ef9 is going to be created. [ 877.735843] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.736346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.736346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.736527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.736793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.750889] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 in Status: IN_PROGRESS for 2s [ 877.752499] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.752712] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.752832] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.753132] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.753428] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.753651] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.509956] env[66364]: INFO networking_nsxv3.common.synchronization [req-9847432a-a89a-4705-aa55-acdaa965ab42 req-87be122a-dc47-4e9c-88dd-9020c82acb33 service nova] Enqueued Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGHEST for action security_group_rules [ 878.510324] env[66364]: INFO networking_nsxv3.common.synchronization [req-9847432a-a89a-4705-aa55-acdaa965ab42 req-87be122a-dc47-4e9c-88dd-9020c82acb33 service nova] Enqueued Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGHEST for action security_group_members [ 878.510324] env[66364]: INFO networking_nsxv3.common.synchronization [req-9847432a-a89a-4705-aa55-acdaa965ab42 req-87be122a-dc47-4e9c-88dd-9020c82acb33 service nova] Enqueued Resource ID: 28c36a1e-02ca-4aa9-8f17-295f0eb95ef9 with Priority: HIGHEST for action port [ 878.510782] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGHEST for action security_group_rules [ 878.510921] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGHEST for action security_group_members [ 878.512149] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28c36a1e-02ca-4aa9-8f17-295f0eb95ef9 with Priority: HIGHEST for action port [ 878.512149] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.512149] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.512149] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.512503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.512503] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.513305] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.513796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.513796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.513796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.514048] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.514048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.514158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.518029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.518029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.518029] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.518029] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.518029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.518029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.518029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.518029] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28c36a1e-02ca-4aa9-8f17-295f0eb95ef9',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.018559] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.018559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.018701] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.019905] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28c36a1e-02ca-4aa9-8f17-295f0eb95ef9 with status ACTIVE [ 879.019905] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.019905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.019905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.020128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.020215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.020402] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.020509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.020571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.020794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.020843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.023693] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.023693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.023693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.023693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.023693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.023693] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28c36a1e-02ca-4aa9-8f17-295f0eb95ef9 is going to be updated. [ 879.052507] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.052853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.052853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.052952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.053116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.053282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28c36a1e-02ca-4aa9-8f17-295f0eb95ef9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.527386] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.613625] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 in Status: SUCCESS [ 879.613887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.614030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.614254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.615035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.615035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.615035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.615035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.615035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.615035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.615035] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.768674] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 in Status: SUCCESS [ 879.768893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.030207] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.033541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.033541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.033541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.033541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.033541] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d is going to be created. [ 880.061818] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.061976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.062183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.062253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.062415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.073882] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d in Status: UNINITIALIZED for 2s [ 880.117387] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.425836] env[66364]: INFO networking_nsxv3.common.synchronization [None req-5e1cce78-1f7f-448a-aa0c-cdcba8ec8c29 None None] Enqueued Resource ID: c4d73406-1a43-4877-ba45-b1e002dac200 with Priority: HIGHEST for action port [ 880.428023] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4d73406-1a43-4877-ba45-b1e002dac200 with Priority: HIGHEST for action port [ 880.428693] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4d73406-1a43-4877-ba45-b1e002dac200 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.429056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4d73406-1a43-4877-ba45-b1e002dac200" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.429056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4d73406-1a43-4877-ba45-b1e002dac200" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.430357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4d73406-1a43-4877-ba45-b1e002dac200" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.430357] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4d73406-1a43-4877-ba45-b1e002dac200',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.621105] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789: rpc.has_security_group_logging(os_id): False [ 880.651019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.651019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.651019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.651019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.651019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.651019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.651019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.651019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.651019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.651019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.651019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 is going to be created. [ 880.726143] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.726143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.726143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.726143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.726143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.738741] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 in Status: IN_PROGRESS for 2s [ 880.933167] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4d73406-1a43-4877-ba45-b1e002dac200 [ 880.933472] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.933611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.933675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.933891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.933972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.934076] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4d73406-1a43-4877-ba45-b1e002dac200 already deleted. [ 880.934157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4d73406-1a43-4877-ba45-b1e002dac200" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.449852] env[66364]: INFO networking_nsxv3.common.synchronization [None req-7d497a8d-100e-49f6-8fee-2cdd4141e6e6 tempest-ServersV294TestFqdnHostnames-649041268 tempest-ServersV294TestFqdnHostnames-649041268-project-member] Enqueued Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_rules [ 881.450961] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_rules [ 881.450961] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.450961] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.451207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.451565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.451665] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.670049] env[66364]: INFO networking_nsxv3.common.synchronization [None req-2cd164a2-eb10-4cf3-ad7c-71c8a2f25d0c tempest-ServersV294TestFqdnHostnames-649041268 tempest-ServersV294TestFqdnHostnames-649041268-project-member] Enqueued Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_rules [ 881.670622] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_rules [ 881.671840] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.673049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.093114] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d in Status: SUCCESS [ 882.093114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.093114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.093114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.093114] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.093114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.093114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.093539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.093539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.093539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.093539] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.097088] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.097088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.097088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.097088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.097088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.097088] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd already deleted. [ 882.097088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.097088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.097088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.097088] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.601038] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.601038] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.601038] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.601038] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.601038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.602127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.602127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.602127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.602127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.602127] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.623341] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.623341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.623341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.623341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.623341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.623341] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd already deleted. [ 882.623341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.752530] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 in Status: SUCCESS [ 882.753498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.771800] env[66364]: INFO networking_nsxv3.common.synchronization [req-57943864-84e7-43fe-acd3-c320317e1235 req-68a4fe42-30e8-4a70-b833-00ee1efbc220 tempest-ImagesOneServerNegativeTestJSON-519635427 tempest-ImagesOneServerNegativeTestJSON-519635427-project-member] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 882.772403] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 882.772720] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.772844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.772911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.773800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.774022] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.774144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.774212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.774387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.774464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.774719] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.104411] env[66364]: INFO networking_nsxv3.common.synchronization [None req-de163ace-2fca-460a-b9f0-30d6f34d2b2c None None] Enqueued Resource ID: 66dc8d5b-684a-4e39-a124-2b9459cb531a with Priority: HIGHEST for action port [ 883.104706] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d: rpc.has_security_group_logging(os_id): False [ 883.109205] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66dc8d5b-684a-4e39-a124-2b9459cb531a with Priority: HIGHEST for action port [ 883.109590] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-66dc8d5b-684a-4e39-a124-2b9459cb531a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.110023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66dc8d5b-684a-4e39-a124-2b9459cb531a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.110023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66dc8d5b-684a-4e39-a124-2b9459cb531a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.110122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66dc8d5b-684a-4e39-a124-2b9459cb531a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.110159] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66dc8d5b-684a-4e39-a124-2b9459cb531a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.129451] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.129614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.129685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.129925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.129981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.130201] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.130300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.130360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.130520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.130596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.130781] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.131148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.131148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.131148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.131262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.131360] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.131503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.131503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.131639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.131713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.131794] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d is going to be created. [ 883.197324] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.197565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.197565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.197768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.197985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.213649] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d in Status: IN_PROGRESS for 2s [ 883.277479] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.278322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.278322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.278322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.309601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.309950] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.310161] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.310367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.310598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.310735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.310948] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be updated. [ 883.345696] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.345862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.345909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.346137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.346289] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.356254] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 883.389028] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-856 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.389028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.389028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.389028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.389028] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.389028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.389028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.390744] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.390744] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.391114] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.393273] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.393273] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.393273] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.393273] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.393273] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.393273] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.415034] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.415197] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.415336] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.415534] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-856" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.415922] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-d8003a75-5f22-4d1a-ac1f-47ca05990c08 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.416164] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-d8003a75-5f22-4d1a-ac1f-47ca05990c08" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.416336] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-d8003a75-5f22-4d1a-ac1f-47ca05990c08" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.416661] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-d8003a75-5f22-4d1a-ac1f-47ca05990c08" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.417159] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8003a75-5f22-4d1a-ac1f-47ca05990c08',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.613803] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66dc8d5b-684a-4e39-a124-2b9459cb531a [ 883.616708] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.616708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.616708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.616708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.616708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.616708] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66dc8d5b-684a-4e39-a124-2b9459cb531a already deleted. [ 883.616708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66dc8d5b-684a-4e39-a124-2b9459cb531a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.920506] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.920506] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.920506] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.920969] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.920969] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.921052] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port d8003a75-5f22-4d1a-ac1f-47ca05990c08 not found, creating... [ 883.921381] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.921592] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.921745] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.922048] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.922235] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.922575] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.922781] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.922920] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.923198] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.923363] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.923624] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: d8003a75-5f22-4d1a-ac1f-47ca05990c08 is going to be created. [ 883.948384] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.948650] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.948822] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.949177] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.949461] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.949749] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-d8003a75-5f22-4d1a-ac1f-47ca05990c08" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.715152] env[66364]: INFO networking_nsxv3.common.synchronization [req-57943864-84e7-43fe-acd3-c320317e1235 req-59155d8d-4895-4131-b758-41833c1c7887 service nova] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_rules [ 884.716326] env[66364]: INFO networking_nsxv3.common.synchronization [req-57943864-84e7-43fe-acd3-c320317e1235 req-59155d8d-4895-4131-b758-41833c1c7887 service nova] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 884.716326] env[66364]: INFO networking_nsxv3.common.synchronization [req-57943864-84e7-43fe-acd3-c320317e1235 req-59155d8d-4895-4131-b758-41833c1c7887 service nova] Enqueued Resource ID: d8003a75-5f22-4d1a-ac1f-47ca05990c08 with Priority: HIGHEST for action port [ 884.716326] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_rules [ 884.716326] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 884.716326] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8003a75-5f22-4d1a-ac1f-47ca05990c08 with Priority: HIGHEST for action port [ 884.716520] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.716520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.716659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.716776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.716918] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.717684] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.717730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.717913] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8003a75-5f22-4d1a-ac1f-47ca05990c08 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.718045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8003a75-5f22-4d1a-ac1f-47ca05990c08" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.718072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8003a75-5f22-4d1a-ac1f-47ca05990c08" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.718232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8003a75-5f22-4d1a-ac1f-47ca05990c08" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.718303] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8003a75-5f22-4d1a-ac1f-47ca05990c08',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.220383] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.220692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.223046] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8003a75-5f22-4d1a-ac1f-47ca05990c08 with status ACTIVE [ 885.223256] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.223377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.223550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.223747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.223854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.224109] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.224213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.224659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.224659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.224659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.224659] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.225121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.225121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.225121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.225121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.225358] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8003a75-5f22-4d1a-ac1f-47ca05990c08 is going to be updated. [ 885.226905] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d in Status: SUCCESS [ 885.227113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.250045] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.250210] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.250250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.250520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.250691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.250919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8003a75-5f22-4d1a-ac1f-47ca05990c08" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.367826] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 885.368058] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f deletion is rescheduled due to dependency. [ 885.368239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.368305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.368531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.368723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.368948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.369020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.369243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.369335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.369473] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.875253] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.377779] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.881729] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.882436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.882604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.883648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.883648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.883648] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be updated. [ 886.916339] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.916500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.916563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.916765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.916914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.929111] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 886.969536] env[66364]: INFO networking_nsxv3.common.synchronization [None req-fbf2737c-63aa-4c33-b324-62c00b10802a None None] Enqueued Resource ID: 229fbcd2-85d6-481d-99cc-d5b7cb9f1955 with Priority: HIGHEST for action port [ 886.970102] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 229fbcd2-85d6-481d-99cc-d5b7cb9f1955 with Priority: HIGHEST for action port [ 886.970413] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-229fbcd2-85d6-481d-99cc-d5b7cb9f1955 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.970536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-229fbcd2-85d6-481d-99cc-d5b7cb9f1955" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.970601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-229fbcd2-85d6-481d-99cc-d5b7cb9f1955" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.970855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-229fbcd2-85d6-481d-99cc-d5b7cb9f1955" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.970995] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('229fbcd2-85d6-481d-99cc-d5b7cb9f1955',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.474998] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 229fbcd2-85d6-481d-99cc-d5b7cb9f1955 [ 887.474998] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.474998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.474998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.475481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.475481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.475481] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:229fbcd2-85d6-481d-99cc-d5b7cb9f1955 already deleted. [ 887.475481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-229fbcd2-85d6-481d-99cc-d5b7cb9f1955" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.273335] env[66364]: INFO networking_nsxv3.common.synchronization [None req-ef8bf197-8b32-4a0d-899f-67541653ca3f None None] Enqueued Resource ID: cce4f157-f98d-4585-b7d8-6cda7f7845a0 with Priority: HIGHEST for action port [ 888.274251] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cce4f157-f98d-4585-b7d8-6cda7f7845a0 with Priority: HIGHEST for action port [ 888.274791] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-cce4f157-f98d-4585-b7d8-6cda7f7845a0 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.274916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cce4f157-f98d-4585-b7d8-6cda7f7845a0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.275020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cce4f157-f98d-4585-b7d8-6cda7f7845a0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.275286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cce4f157-f98d-4585-b7d8-6cda7f7845a0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.275402] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cce4f157-f98d-4585-b7d8-6cda7f7845a0',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.781165] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cce4f157-f98d-4585-b7d8-6cda7f7845a0 [ 888.783732] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.783732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.783732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.783732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.783732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.783732] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cce4f157-f98d-4585-b7d8-6cda7f7845a0 already deleted. [ 888.783732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cce4f157-f98d-4585-b7d8-6cda7f7845a0" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.943854] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 888.944101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.944719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.944719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.944719] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.944903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.944903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.945424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.945424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.945424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.945424] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.448509] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.449015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.449015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.449125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.449321] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.449670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.449670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.449776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.449804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.449913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.450083] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.450177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.450237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.450425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.450636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.450753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.450805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.451021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.451249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.451392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.451527] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.799842] env[66364]: INFO networking_nsxv3.common.synchronization [None req-d0a848a1-a905-4e98-9fb0-05612a08e1d4 None None] Enqueued Resource ID: c17e1a40-3023-4699-9f5b-224123503690 with Priority: HIGHEST for action port [ 889.801090] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c17e1a40-3023-4699-9f5b-224123503690 with Priority: HIGHEST for action port [ 889.801834] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c17e1a40-3023-4699-9f5b-224123503690 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.801992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c17e1a40-3023-4699-9f5b-224123503690" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.801992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c17e1a40-3023-4699-9f5b-224123503690" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.802314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c17e1a40-3023-4699-9f5b-224123503690" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.802552] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c17e1a40-3023-4699-9f5b-224123503690',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.956251] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 296f3936-dac0-44a8-a46a-d39ee062c69f: rpc.has_security_group_logging(os_id): False [ 889.978092] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.978359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.978359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.978509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.978595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.978806] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.980105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.980105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.980105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.980105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.980105] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.980105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.980105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.980105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.980105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.980105] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.982035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.982035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.982261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.982261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.982261] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be updated. [ 890.075108] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.075108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.075108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.075108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.075108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.085735] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 890.250722] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.250937] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.251089] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.251920] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.251920] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.251920] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.252459] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.252459] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.252576] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.252874] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.253037] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.253211] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.253358] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.253530] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.253686] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.253853] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.276791] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.276791] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 890.276791] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.276791] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.276791] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-e432e73a-cdaf-4da4-b34b-f90661dd8549 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.276791] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.276791] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.276791] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.276791] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e432e73a-cdaf-4da4-b34b-f90661dd8549',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.308526] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c17e1a40-3023-4699-9f5b-224123503690 [ 890.308526] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.308526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.308526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.308526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.308526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.308526] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c17e1a40-3023-4699-9f5b-224123503690 already deleted. [ 890.308526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c17e1a40-3023-4699-9f5b-224123503690" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.362147] env[66364]: INFO networking_nsxv3.common.synchronization [None req-17de5285-aad5-471e-a85b-887a80b63899 None None] Enqueued Resource ID: c22b3199-15fb-46fb-8df9-aa0be4861bec with Priority: HIGHEST for action port [ 890.362658] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c22b3199-15fb-46fb-8df9-aa0be4861bec with Priority: HIGHEST for action port [ 890.363196] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c22b3199-15fb-46fb-8df9-aa0be4861bec taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.363314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c22b3199-15fb-46fb-8df9-aa0be4861bec" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.363495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c22b3199-15fb-46fb-8df9-aa0be4861bec" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.363693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c22b3199-15fb-46fb-8df9-aa0be4861bec" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.363791] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c22b3199-15fb-46fb-8df9-aa0be4861bec',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.780216] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.780516] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.780689] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.781114] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.781310] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.781608] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.781767] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.781880] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.782134] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.782420] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.782555] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.782714] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.782816] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.783035] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.783169] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.783327] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: e432e73a-cdaf-4da4-b34b-f90661dd8549 is going to be updated. [ 890.810897] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.811341] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.811382] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.811717] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.811971] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.812293] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.866032] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c22b3199-15fb-46fb-8df9-aa0be4861bec [ 890.866360] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.866578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.866701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.866951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.867440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.867440] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c22b3199-15fb-46fb-8df9-aa0be4861bec already deleted. [ 890.867440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c22b3199-15fb-46fb-8df9-aa0be4861bec" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.895197] env[66364]: INFO networking_nsxv3.common.synchronization [None req-399c83ae-9294-45d5-b512-0a9dc9439a5f None None] Enqueued Resource ID: 26caee1d-6eb5-4afb-a095-7218d2e00c86 with Priority: HIGHEST for action port [ 890.895950] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26caee1d-6eb5-4afb-a095-7218d2e00c86 with Priority: HIGHEST for action port [ 890.896309] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-26caee1d-6eb5-4afb-a095-7218d2e00c86 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.896453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26caee1d-6eb5-4afb-a095-7218d2e00c86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.896574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26caee1d-6eb5-4afb-a095-7218d2e00c86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.896917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26caee1d-6eb5-4afb-a095-7218d2e00c86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.897674] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26caee1d-6eb5-4afb-a095-7218d2e00c86',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.260755] env[66364]: INFO networking_nsxv3.common.synchronization [req-fddb0d7f-12e0-41a0-bf06-fa06b3bb9296 req-ca294782-5c5b-48a7-92e3-c6daf2961d36 tempest-ServersAdminTestJSON-1239172367 tempest-ServersAdminTestJSON-1239172367-project-member] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 891.260941] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 891.261274] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.261884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.261884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.261884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.261884] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.262097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.262097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.262222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.262311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.262370] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.402382] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26caee1d-6eb5-4afb-a095-7218d2e00c86 [ 891.402663] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.402820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.402860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.403119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.403631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.403631] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26caee1d-6eb5-4afb-a095-7218d2e00c86 already deleted. [ 891.403631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26caee1d-6eb5-4afb-a095-7218d2e00c86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.575302] env[66364]: INFO networking_nsxv3.common.synchronization [req-951a748b-a8e3-4a8a-94e4-d1754c97a349 req-3ea45d4b-ac38-4343-be21-7f35abfb439b service nova] Enqueued Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_rules [ 891.575475] env[66364]: INFO networking_nsxv3.common.synchronization [req-951a748b-a8e3-4a8a-94e4-d1754c97a349 req-3ea45d4b-ac38-4343-be21-7f35abfb439b service nova] Enqueued Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_members [ 891.575610] env[66364]: INFO networking_nsxv3.common.synchronization [req-951a748b-a8e3-4a8a-94e4-d1754c97a349 req-3ea45d4b-ac38-4343-be21-7f35abfb439b service nova] Enqueued Resource ID: e432e73a-cdaf-4da4-b34b-f90661dd8549 with Priority: HIGHEST for action port [ 891.575874] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_rules [ 891.576028] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_members [ 891.576131] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e432e73a-cdaf-4da4-b34b-f90661dd8549 with Priority: HIGHEST for action port [ 891.576700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.576806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.576875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.579185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.579185] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.579185] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.579185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.579185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.579185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.579682] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.579801] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.579863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.580031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.580117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.580206] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.582211] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e432e73a-cdaf-4da4-b34b-f90661dd8549 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.582294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.582362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.582547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.586245] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e432e73a-cdaf-4da4-b34b-f90661dd8549',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.696039] env[66364]: INFO networking_nsxv3.common.synchronization [None req-41d4a42d-7144-4f46-8ee8-88d92e7bccfd tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_rules [ 891.696039] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_rules [ 891.696039] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-caf65fab-7b8a-4ed0-8b20-496896e11d68 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.696039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.696039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.696039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.696039] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.766790] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.900444] env[66364]: INFO networking_nsxv3.common.synchronization [req-68159cf5-a567-48c5-8d2a-334345b29c0d req-b6ea88af-cc13-4374-89b6-a7dd9e9becbc tempest-ServerActionsV293TestJSON-383694888 tempest-ServerActionsV293TestJSON-383694888-project-member] Enqueued Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_members [ 891.902129] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGHEST for action security_group_members [ 891.902129] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4749461-177d-4d2d-9817-47596fbff3b5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.902129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.902129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.902129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.902129] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.902129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.902129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.903022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.903478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.903478] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.083013] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.085903] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.086036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.090644] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e432e73a-cdaf-4da4-b34b-f90661dd8549 with status ACTIVE [ 892.090874] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.091040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.091089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.091286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.091382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.091584] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.091682] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.091741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.091906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.091980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.092170] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.092257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.092313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.092445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.092522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.092599] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e432e73a-cdaf-4da4-b34b-f90661dd8549 is going to be updated. [ 892.100281] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 892.100517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.114939] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.115589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.115786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.116090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.117035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.117035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e432e73a-cdaf-4da4-b34b-f90661dd8549" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.119048] env[66364]: INFO networking_nsxv3.common.synchronization [None req-3957893e-c730-4182-8bcc-0fb49b741a88 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_rules [ 892.119048] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_rules [ 892.119231] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-caf65fab-7b8a-4ed0-8b20-496896e11d68 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.119320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.229314] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.229314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.229522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.230033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.230033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.230033] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 already deleted. [ 892.230033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.230556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.230556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.230556] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.269247] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.277292] env[66364]: INFO networking_nsxv3.common.synchronization [None req-720b390b-d1e2-4155-839d-a9ac1366e172 None None] Enqueued Resource ID: ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4 with Priority: HIGHEST for action port [ 892.277545] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4 with Priority: HIGHEST for action port [ 892.278284] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.278284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.278380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.278546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.278639] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.282601] env[66364]: INFO networking_nsxv3.common.synchronization [req-bc92d828-5824-4e88-9e40-b4ad2749a30f req-0f80c324-2711-4da5-a0b1-57dbe37c8b67 tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 892.284543] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 892.284714] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.284797] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.285203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.285203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.285302] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.285410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.285486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.285656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.285704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.285776] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.407420] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.407420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.407420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.407420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.429700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.430146] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.430146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.430146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.430331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.430408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.430509] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4749461-177d-4d2d-9817-47596fbff3b5 is going to be updated. [ 892.461363] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.461619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.461619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.461993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.461993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.474504] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4749461-177d-4d2d-9817-47596fbff3b5 in Status: IN_PROGRESS for 2s [ 892.585711] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.753057] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.753258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.753258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.753561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.753702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.753751] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 already deleted. [ 892.753837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.773672] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.773869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.773869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.774046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.774153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.774337] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 892.784296] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4 [ 892.784592] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.784700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.784770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.784983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.785085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.785183] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4 already deleted. [ 892.785261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea1501ee-06d7-4b51-afc8-bbd2ec7ceec4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.787950] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.810588] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.810588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.810588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.810588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.810588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.821742] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 893.088533] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.088903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.088903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.089068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.089180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.089281] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0345151-3287-4add-b6b3-bbb72460c6bd is going to be updated. [ 893.122046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.122956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.122956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.122956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.123102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.136062] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: IN_PROGRESS for 2s [ 893.294173] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.797335] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.799916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.799916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.799916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.799916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.799916] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 893.836017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.837342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.837342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.837342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.837342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.849386] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 894.489457] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4749461-177d-4d2d-9817-47596fbff3b5 in Status: SUCCESS [ 894.489783] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4749461-177d-4d2d-9817-47596fbff3b5 deletion is rescheduled due to dependency. [ 894.489783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.834146] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 894.834324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.108382] env[66364]: INFO networking_nsxv3.common.synchronization [req-2393e395-8380-4bba-a7b1-a1459ae13df6 req-dd936d45-ec25-4001-b5f0-1e5c9459e832 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_members [ 895.109328] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_members [ 895.109328] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6d923ea-108c-4ea6-b072-aa5974291da3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.109556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.109556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.109766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.109926] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.110694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.110694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.110694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.110694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.110694] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.147338] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: SUCCESS [ 895.147574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.147730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.148025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.148380] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.148380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.148380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.149038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.149038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.149038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.149038] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.551037] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.552050] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.552340] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.552531] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.553993] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.553993] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.553993] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.553993] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.553993] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.553993] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.553993] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.553993] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.554340] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.554340] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.554340] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.554439] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.578610] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.578797] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.578937] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.579151] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.579478] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-39503e2f-4509-40ce-b7b2-a258c79db901 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.579650] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-39503e2f-4509-40ce-b7b2-a258c79db901" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.579766] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-39503e2f-4509-40ce-b7b2-a258c79db901" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.580108] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-39503e2f-4509-40ce-b7b2-a258c79db901" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.580248] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39503e2f-4509-40ce-b7b2-a258c79db901',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.614197] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.614377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.614454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.614697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.614792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.614999] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.615107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.615169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.615328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.615404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.615487] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6d923ea-108c-4ea6-b072-aa5974291da3 already deleted. [ 895.615569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.650870] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.860728] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 895.860967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.082888] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.083150] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.083278] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.083588] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.083742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.083895] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 39503e2f-4509-40ce-b7b2-a258c79db901 not found, creating... [ 896.084296] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.084399] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.084440] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.084680] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.084813] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.085119] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.085274] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.085389] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.085601] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.085752] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.085890] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 39503e2f-4509-40ce-b7b2-a258c79db901 is going to be created. [ 896.106806] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.107047] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.107155] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.107449] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.107674] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.107901] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-39503e2f-4509-40ce-b7b2-a258c79db901" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.155097] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0345151-3287-4add-b6b3-bbb72460c6bd: rpc.has_security_group_logging(os_id): False [ 896.173023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.173183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.173347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.173460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.199391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.199391] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.199391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.199391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.199391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.199391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.199391] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0345151-3287-4add-b6b3-bbb72460c6bd is going to be updated. [ 896.308619] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.309329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.309503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.309792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.310038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.331344] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: IN_PROGRESS for 2s [ 896.835214] env[66364]: INFO networking_nsxv3.common.synchronization [req-2393e395-8380-4bba-a7b1-a1459ae13df6 req-02aaaed5-b65d-4cd8-bef8-55147c0946bc service nova] Enqueued Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_rules [ 896.835214] env[66364]: INFO networking_nsxv3.common.synchronization [req-2393e395-8380-4bba-a7b1-a1459ae13df6 req-02aaaed5-b65d-4cd8-bef8-55147c0946bc service nova] Enqueued Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_members [ 896.835214] env[66364]: INFO networking_nsxv3.common.synchronization [req-2393e395-8380-4bba-a7b1-a1459ae13df6 req-02aaaed5-b65d-4cd8-bef8-55147c0946bc service nova] Enqueued Resource ID: 39503e2f-4509-40ce-b7b2-a258c79db901 with Priority: HIGHEST for action port [ 896.835214] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_rules [ 896.835214] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_members [ 896.835214] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39503e2f-4509-40ce-b7b2-a258c79db901 with Priority: HIGHEST for action port [ 896.835214] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6d923ea-108c-4ea6-b072-aa5974291da3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.835214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.837372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.837739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.837951] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.841075] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6d923ea-108c-4ea6-b072-aa5974291da3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.841075] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.841075] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.841075] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-39503e2f-4509-40ce-b7b2-a258c79db901 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39503e2f-4509-40ce-b7b2-a258c79db901" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39503e2f-4509-40ce-b7b2-a258c79db901" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.841075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39503e2f-4509-40ce-b7b2-a258c79db901" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.842032] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39503e2f-4509-40ce-b7b2-a258c79db901',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.112448] env[66364]: INFO networking_nsxv3.common.synchronization [req-31154eac-9b4e-43b9-bb7f-61d8a61da6d5 req-e23b082b-82a0-479e-9a4b-6384951988f4 tempest-ServerAddressesNegativeTestJSON-1266249142 tempest-ServerAddressesNegativeTestJSON-1266249142-project-member] Enqueued Resource ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 with Priority: HIGHEST for action security_group_members [ 897.113091] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 with Priority: HIGHEST for action security_group_members [ 897.114060] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.114060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.114060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.114218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.114315] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.114419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.114515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.116966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.116966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.116966] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a80c29ba-9fac-4002-9bc5-2c6f28eafc86',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.344095] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6d923ea-108c-4ea6-b072-aa5974291da3 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.344095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.344274] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.345160] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39503e2f-4509-40ce-b7b2-a258c79db901 with status ACTIVE [ 897.345403] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.345484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.346058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.346058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.346058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.346058] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.346234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.346234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.346363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.346363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.346555] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.346639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.346693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.346842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.347570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.347570] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39503e2f-4509-40ce-b7b2-a258c79db901 is going to be updated. [ 897.370688] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.370946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.371054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.371275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.371512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.371676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39503e2f-4509-40ce-b7b2-a258c79db901" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.617695] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.617901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.617901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.618153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.618261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.618441] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.618547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.618584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.618729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.618835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.618896] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 is going to be updated. [ 897.649723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.649900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.650268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.650268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.650385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.659180] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 in Status: IN_PROGRESS for 2s [ 897.849829] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.990545] env[66364]: INFO networking_nsxv3.common.synchronization [req-fe63be9a-b545-42ff-b2c0-6a8df0ea4e9c req-043d139e-e8be-4a41-95f9-09475a9fb956 tempest-MigrationsAdminTest-172536833 tempest-MigrationsAdminTest-172536833-project-member] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 897.991283] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 897.991948] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.991948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.992149] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.992325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.992587] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.992770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.992888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.993148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.993250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.993359] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.345584] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: SUCCESS [ 898.345870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.352887] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.353431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.353431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.353431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.355228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.355228] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6d923ea-108c-4ea6-b072-aa5974291da3 is going to be created. [ 898.380097] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.380323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.380323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.380494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.380650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.392748] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6d923ea-108c-4ea6-b072-aa5974291da3 in Status: UNINITIALIZED for 2s [ 898.492409] env[66364]: INFO networking_nsxv3.common.synchronization [req-0887556c-7d89-47ae-b0f9-4cdce48312f5 req-cf940870-cc42-4662-8349-8e75120e69a2 tempest-ServerAddressesTestJSON-376661275 tempest-ServerAddressesTestJSON-376661275-project-member] Enqueued Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGHEST for action security_group_members [ 898.493320] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGHEST for action security_group_members [ 898.493718] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.493868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.493999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.494183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.494610] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.494784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.494843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.495024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.495148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.495218] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.497099] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.997822] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.998326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.998326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.998544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.998667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.999035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.999147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.999244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.999522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.999678] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.999824] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d is going to be updated. [ 899.002067] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.033437] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.033824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.033946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.034465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.036905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.047395] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d in Status: IN_PROGRESS for 2s [ 899.129376] env[66364]: INFO networking_nsxv3.common.synchronization [req-72267592-cc47-431b-8e43-b3136d84611c req-401138c3-c841-4504-bbf9-b1a0c4f6d6c8 tempest-ServersV294TestFqdnHostnames-649041268 tempest-ServersV294TestFqdnHostnames-649041268-project-member] Enqueued Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_members [ 899.129708] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_members [ 899.130039] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc73d65-12db-4adf-90af-f7bd6b67d4fd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.130169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.130242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.130509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.130669] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.130771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.130831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.130982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.131089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.131183] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.506343] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.506472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.506472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.506736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.506794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.506972] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 is going to be updated. [ 899.528257] env[66364]: INFO networking_nsxv3.common.synchronization [None req-5a87a8af-6540-4831-8b33-b91537eeeecf None None] Enqueued Resource ID: e51a3cb4-22f2-4a16-88ed-00dbcdab75ff with Priority: HIGHEST for action port [ 899.528881] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e51a3cb4-22f2-4a16-88ed-00dbcdab75ff with Priority: HIGHEST for action port [ 899.529239] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e51a3cb4-22f2-4a16-88ed-00dbcdab75ff taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.529363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e51a3cb4-22f2-4a16-88ed-00dbcdab75ff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.529417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e51a3cb4-22f2-4a16-88ed-00dbcdab75ff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.529769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e51a3cb4-22f2-4a16-88ed-00dbcdab75ff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.529858] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e51a3cb4-22f2-4a16-88ed-00dbcdab75ff',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.543307] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.543444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.543548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.543779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.543938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.556103] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: IN_PROGRESS for 2s [ 899.607496] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.607709] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-586" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.607852] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-586" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.608238] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-586" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.608512] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.608684] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.608799] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.609052] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.609199] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.609410] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.609604] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.609604] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.609719] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.609838] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.609994] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.610188] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.632682] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.632839] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 899.632935] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.633154] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-586" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.633642] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-9d0853db-3096-4a44-bef4-8757c40995a8 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.633728] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-9d0853db-3096-4a44-bef4-8757c40995a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.633912] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-9d0853db-3096-4a44-bef4-8757c40995a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.634357] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-9d0853db-3096-4a44-bef4-8757c40995a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.634593] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d0853db-3096-4a44-bef4-8757c40995a8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.635597] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.635778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.635873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.636061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.636162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.636349] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.636469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.636527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.636694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.636800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.636914] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd already deleted. [ 899.637013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.669664] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 in Status: SUCCESS [ 899.669825] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a80c29ba-9fac-4002-9bc5-2c6f28eafc86 deletion is rescheduled due to dependency. [ 899.669940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a80c29ba-9fac-4002-9bc5-2c6f28eafc86" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.027650] env[66364]: INFO networking_nsxv3.common.synchronization [req-b9b3b211-ec9d-417d-82a7-6022b4dc493c req-559c5350-0cca-484b-bbdd-7817be891c52 tempest-ImagesOneServerNegativeTestJSON-519635427 tempest-ImagesOneServerNegativeTestJSON-519635427-project-member] Enqueued Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 900.028893] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296f3936-dac0-44a8-a46a-d39ee062c69f with Priority: HIGHEST for action security_group_members [ 900.029521] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-296f3936-dac0-44a8-a46a-d39ee062c69f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.029807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.029968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.030285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.030545] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.030767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.031177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.031624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.031823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.032104] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('296f3936-dac0-44a8-a46a-d39ee062c69f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.033458] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e51a3cb4-22f2-4a16-88ed-00dbcdab75ff [ 900.033848] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.034099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.034260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.034547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.034815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.037951] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e51a3cb4-22f2-4a16-88ed-00dbcdab75ff already deleted. [ 900.037951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e51a3cb4-22f2-4a16-88ed-00dbcdab75ff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.138300] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.138680] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.138680] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.139022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.139145] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.139302] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 9d0853db-3096-4a44-bef4-8757c40995a8 not found, creating... [ 900.139572] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.139734] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.139847] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.140092] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.140233] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.140544] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.140708] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.141086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.141363] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.141542] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.141762] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 9d0853db-3096-4a44-bef4-8757c40995a8 is going to be created. [ 900.167012] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.167012] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.167012] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.167012] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.167396] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.167396] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-9d0853db-3096-4a44-bef4-8757c40995a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.407061] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6d923ea-108c-4ea6-b072-aa5974291da3 in Status: SUCCESS [ 900.407376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.407643] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.407966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.408263] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.408437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.408536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.408789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.408916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.409067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.409236] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.538545] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.538666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.538706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.538923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.539364] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.540059] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.540211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.540283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.540469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.540556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.540644] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f is going to be updated. [ 900.575022] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.575022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.575022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.575022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.575981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.589720] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: IN_PROGRESS for 2s [ 900.911991] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.949733] env[66364]: INFO networking_nsxv3.common.synchronization [req-72267592-cc47-431b-8e43-b3136d84611c req-b2869a26-4f3a-4c64-b708-b1c05fcdeaba service nova] Enqueued Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_rules [ 900.950440] env[66364]: INFO networking_nsxv3.common.synchronization [req-72267592-cc47-431b-8e43-b3136d84611c req-b2869a26-4f3a-4c64-b708-b1c05fcdeaba service nova] Enqueued Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_members [ 900.950440] env[66364]: INFO networking_nsxv3.common.synchronization [req-72267592-cc47-431b-8e43-b3136d84611c req-b2869a26-4f3a-4c64-b708-b1c05fcdeaba service nova] Enqueued Resource ID: 9d0853db-3096-4a44-bef4-8757c40995a8 with Priority: HIGHEST for action port [ 900.950942] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_rules [ 900.951156] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_members [ 900.951331] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d0853db-3096-4a44-bef4-8757c40995a8 with Priority: HIGHEST for action port [ 900.951792] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.955229] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.955229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc73d65-12db-4adf-90af-f7bd6b67d4fd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.955229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.955229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.955229] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.955229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d0853db-3096-4a44-bef4-8757c40995a8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.955900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d0853db-3096-4a44-bef4-8757c40995a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.955900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d0853db-3096-4a44-bef4-8757c40995a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.955900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d0853db-3096-4a44-bef4-8757c40995a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.955900] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d0853db-3096-4a44-bef4-8757c40995a8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.061853] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d in Status: SUCCESS [ 901.062147] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d deletion is rescheduled due to dependency. [ 901.062188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.416273] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6d923ea-108c-4ea6-b072-aa5974291da3: rpc.has_security_group_logging(os_id): False [ 901.438989] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.438989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.438989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.438989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.438989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.439912] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.440293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.440575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.442746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.442746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.442746] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6d923ea-108c-4ea6-b072-aa5974291da3 is going to be created. [ 901.458155] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d0853db-3096-4a44-bef4-8757c40995a8 with status ACTIVE [ 901.461395] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.461395] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.461395] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.461395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.461395] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d0853db-3096-4a44-bef4-8757c40995a8 is going to be updated. [ 901.462974] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc73d65-12db-4adf-90af-f7bd6b67d4fd taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.462974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.463864] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.486085] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.486281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.486356] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.486783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.486783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.486891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d0853db-3096-4a44-bef4-8757c40995a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.519563] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.519969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.520116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.520513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.522112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.538756] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6d923ea-108c-4ea6-b072-aa5974291da3 in Status: IN_PROGRESS for 2s [ 901.568533] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: SUCCESS [ 901.568533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.969872] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.049227] env[66364]: INFO networking_nsxv3.common.synchronization [None req-47838d80-8fa5-4c9d-9734-21352034bebd None None] Enqueued Resource ID: dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff with Priority: HIGHEST for action port [ 902.049993] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff with Priority: HIGHEST for action port [ 902.050921] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.051205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.051276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.051683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.051683] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.472398] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.472828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.472828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.472916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.472959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.473048] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd is going to be created. [ 902.499679] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.499890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.499890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.500125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.500281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.510283] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd in Status: UNINITIALIZED for 2s [ 902.553787] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff [ 902.554583] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.554583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.554583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.554583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.554583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.554917] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff already deleted. [ 902.554917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd8e3b8b-3ec1-4fcb-a45f-a51b9ed62cff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.599336] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 296f3936-dac0-44a8-a46a-d39ee062c69f in Status: SUCCESS [ 902.599534] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 296f3936-dac0-44a8-a46a-d39ee062c69f deletion is rescheduled due to dependency. [ 902.599649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-296f3936-dac0-44a8-a46a-d39ee062c69f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.554754] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6d923ea-108c-4ea6-b072-aa5974291da3 in Status: SUCCESS [ 903.555017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.531121] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd in Status: SUCCESS [ 904.531352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.531559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.531784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.531990] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.532174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.532232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.532375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.532451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.532537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.532627] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.035466] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.264031] env[66364]: INFO networking_nsxv3.common.synchronization [req-763ce4f9-3621-47a3-a3c9-2237d7c22992 req-e648d151-a048-437f-910f-079bf6050f71 tempest-ServersAdminTestJSON-1239172367 tempest-ServersAdminTestJSON-1239172367-project-member] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 905.265522] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGHEST for action security_group_members [ 905.265522] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.265522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.265522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.265522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.265766] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.265821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.265894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.266107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.266195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.266286] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.541263] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edc73d65-12db-4adf-90af-f7bd6b67d4fd: rpc.has_security_group_logging(os_id): False [ 905.562308] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.562431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.562511] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.562836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.562836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.563097] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.563231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.563296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.563456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.563550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.563660] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd is going to be created. [ 905.624858] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.625082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.625131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.625488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.625852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.641159] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd in Status: IN_PROGRESS for 2s [ 905.768948] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.769237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.769398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.769737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.800525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.800525] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.800525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.800525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.800525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.800525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.800525] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be updated. [ 905.835076] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.835242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.835312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.835540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.835687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.852960] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: IN_PROGRESS for 2s [ 906.080176] env[66364]: INFO networking_nsxv3.common.synchronization [req-09ac85e0-50fa-48c5-be30-0409cec69ddf req-92dd7bf4-dc76-4400-a536-45c5bd73fa42 tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 906.080853] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 906.081026] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.081233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.081284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.081632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.081720] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.081795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.081846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.082023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.082140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.082205] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.586140] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.586322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.586360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.586585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.586685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.586894] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.586994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.587069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.587233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.587310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.587402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 906.619440] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.619613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.619718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.619960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.620112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.629214] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 907.371104] env[66364]: INFO networking_nsxv3.common.synchronization [req-6930fc07-ee67-4aed-ab3a-8701ee37b47c req-a7b05c65-382f-4e4e-9d21-bc5d49eacdc0 tempest-ServerRescueTestJSON-343135033 tempest-ServerRescueTestJSON-343135033-project-member] Enqueued Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 907.371384] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 907.372216] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.372216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.372216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.372216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.372513] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.372672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.372756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.372959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.373107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.373226] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.656859] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd in Status: SUCCESS [ 907.657167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.867136] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 in Status: SUCCESS [ 907.867285] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 deletion is rescheduled due to dependency. [ 907.867586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.876017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.876237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.876307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.876531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.876623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.876828] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.876928] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.876984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.877177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.877254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.877338] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c already deleted. [ 907.877633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.908402] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.909050] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-588" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.909050] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-588" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.909291] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-588" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.909570] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.910319] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.910319] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.910563] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.910611] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.911433] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.911433] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.911433] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.911552] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.911636] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.911790] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.911958] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.935971] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.937501] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.937501] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.937501] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-588" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.937737] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.938667] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.938667] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.938667] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.938667] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.442655] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.445054] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.445054] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.445054] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.445054] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.445054] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1 not found, creating... [ 908.445599] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.445818] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.445945] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.446615] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.446802] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.447273] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.447443] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.447573] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.447908] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.448165] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.448314] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1 is going to be created. [ 908.471820] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.472254] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.472507] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.472835] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.473144] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.473471] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.647271] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 908.647590] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 deletion is rescheduled due to dependency. [ 908.647736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.211632] env[66364]: INFO networking_nsxv3.common.synchronization [req-6930fc07-ee67-4aed-ab3a-8701ee37b47c req-39822e93-72a3-441c-9a42-e5efc74871d5 service nova] Enqueued Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_rules [ 909.211801] env[66364]: INFO networking_nsxv3.common.synchronization [req-6930fc07-ee67-4aed-ab3a-8701ee37b47c req-39822e93-72a3-441c-9a42-e5efc74871d5 service nova] Enqueued Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 909.211935] env[66364]: INFO networking_nsxv3.common.synchronization [req-6930fc07-ee67-4aed-ab3a-8701ee37b47c req-39822e93-72a3-441c-9a42-e5efc74871d5 service nova] Enqueued Resource ID: 2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1 with Priority: HIGHEST for action port [ 909.212178] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_rules [ 909.213957] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 909.213957] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1 with Priority: HIGHEST for action port [ 909.214792] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.214792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.214792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.215047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.215047] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.217532] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.217532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.217532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.217532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.217748] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.217748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.217748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.219141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.219141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.219141] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.219758] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.219758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.219881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.220132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.220598] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.724180] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.724180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.724180] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.725050] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1 with status ACTIVE [ 909.725116] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.725230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.725294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.725654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.726973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.726973] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.726973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.726973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.726973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.726973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.726973] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.726973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.726973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.727291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.727291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.727291] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1 is going to be updated. [ 909.748570] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.748762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.748859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.749140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.749316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.749504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ffcb988-1430-49e4-b6cf-1a68fb4f6ab1" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.910722] env[66364]: INFO networking_nsxv3.common.synchronization [req-253c05e4-38f0-41aa-82c5-762a87d3bdea req-33f55f61-028f-463f-91fc-b19dd3787912 tempest-ServersNegativeTestJSON-73704894 tempest-ServersNegativeTestJSON-73704894-project-member] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 909.911616] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 909.911616] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.911766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.911837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.912353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.912522] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.912783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.912783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.912898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.912938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.912999] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.230181] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.253028] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.253028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.253028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.253028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.253028] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.253028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.253445] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.253445] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.253578] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.253905] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.254067] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.254183] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.254286] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.254396] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.254493] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.254638] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.275132] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.275338] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.275501] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.275696] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.276064] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.276413] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.276413] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.276907] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.276907] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd2b6e31-0bf7-48a7-9a73-7538be7fc48f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.416674] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.416878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.416944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.417200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.417291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.417509] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.417606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.417686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.417844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.417992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.418129] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c already deleted. [ 910.418181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.732360] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.732753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.732753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.732847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.732932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.733046] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c is going to be created. [ 910.757867] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.758037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.758109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.758328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.758547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.779081] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: UNINITIALIZED for 2s [ 910.779646] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.780508] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.780508] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.780508] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.780508] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.780688] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port dd2b6e31-0bf7-48a7-9a73-7538be7fc48f not found, creating... [ 910.780944] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.781285] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.781541] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.781952] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.782231] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.782582] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.782836] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.782914] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.783180] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.783433] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.783499] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: dd2b6e31-0bf7-48a7-9a73-7538be7fc48f is going to be created. [ 910.804283] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.804503] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.804611] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.804932] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.805159] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.805374] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.539867] env[66364]: INFO networking_nsxv3.common.synchronization [req-253c05e4-38f0-41aa-82c5-762a87d3bdea req-c948c046-4d1b-49fa-82a1-0e0df976e415 service nova] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_rules [ 911.539993] env[66364]: INFO networking_nsxv3.common.synchronization [req-253c05e4-38f0-41aa-82c5-762a87d3bdea req-c948c046-4d1b-49fa-82a1-0e0df976e415 service nova] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 911.540165] env[66364]: INFO networking_nsxv3.common.synchronization [req-253c05e4-38f0-41aa-82c5-762a87d3bdea req-c948c046-4d1b-49fa-82a1-0e0df976e415 service nova] Enqueued Resource ID: dd2b6e31-0bf7-48a7-9a73-7538be7fc48f with Priority: HIGHEST for action port [ 911.540740] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_rules [ 911.540996] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 911.541199] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b6e31-0bf7-48a7-9a73-7538be7fc48f with Priority: HIGHEST for action port [ 911.541489] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.542787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.542870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.543152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.543232] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.544417] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.544529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.544529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.544721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.544972] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.545139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.545180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.545417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.545549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.545691] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.546645] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.546743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.546797] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.546954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.547045] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd2b6e31-0bf7-48a7-9a73-7538be7fc48f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.049182] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.050901] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.050901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.050901] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd2b6e31-0bf7-48a7-9a73-7538be7fc48f with status ACTIVE [ 912.051130] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.051130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.051223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.051409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.051500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.051679] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.052255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.052255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.052255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.052255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.052446] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.052446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.052594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.052770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.052891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.053037] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd2b6e31-0bf7-48a7-9a73-7538be7fc48f is going to be updated. [ 912.096465] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.096646] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.096698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.096929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.097086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.097250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.556562] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.790827] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: SUCCESS [ 912.791143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.791404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.791758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.792425] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.792425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.792632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.792770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.792951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.793143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.793299] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.060190] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.060515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.060515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.060620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.060708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.060800] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be created. [ 913.084763] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.084989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.085081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.085296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.085563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.095915] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: UNINITIALIZED for 2s [ 913.296094] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.296094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.296094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.296315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.296483] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.297606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.297606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.297606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.297606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.297606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.297606] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.297606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.297606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.297606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.297606] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.298107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.298107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.298107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.298107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.298107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.298107] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.800678] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 779e6414-54c4-4ab2-8678-8a31896ce93c: rpc.has_security_group_logging(os_id): False [ 913.829700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.829872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.829919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.830296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.830405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.830632] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.830745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.830803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.830995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.831091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.831298] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.831391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.831447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.831601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.831704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.831907] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.832015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.832089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.832253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.832320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.832408] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c is going to be created. [ 913.924447] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.924648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.924737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.924926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.925191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.942461] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: IN_PROGRESS for 2s [ 915.031280] env[66364]: INFO networking_nsxv3.common.synchronization [req-575ac436-5c8d-4b4e-80b2-8381ab3a21bf req-1778562e-fd74-43a6-8ace-428fe1263fdd tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_members [ 915.032086] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_members [ 915.033216] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-caf65fab-7b8a-4ed0-8b20-496896e11d68 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.033930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.033930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.034133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.034263] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.034926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.035017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.035215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.035306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.035414] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.109525] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: SUCCESS [ 915.109624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.109769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.109983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.110206] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.110325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.110388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.110563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.110624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.110714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.110799] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.379043] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.379043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.379043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.379043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.379043] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.379043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.379043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.379043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.379043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.379043] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.379043] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.379043] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.379043] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.379861] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.379861] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.379861] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.400826] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.400999] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.401128] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.402166] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.402166] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.402166] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.402166] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.402591] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.402591] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('004c6b6f-52cc-4022-96cb-cb5b4dcf61d8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.538020] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.538219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.538300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.538525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.538615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.538841] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.538978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.538978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.539118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.539193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.539316] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 already deleted. [ 915.539370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.614278] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.614278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.614278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.614278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.614278] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.614278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.614278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.614695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.614695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.614695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.614801] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.614842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.615202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.615202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.615202] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.615350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.615350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.615497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.615590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.615641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.615733] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.907092] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.907327] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.907462] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.907799] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.907959] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.908154] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 004c6b6f-52cc-4022-96cb-cb5b4dcf61d8 not found, creating... [ 915.908415] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.908574] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.908689] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.908958] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.909122] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.909409] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.909562] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.909676] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.909906] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.910060] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.910199] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 004c6b6f-52cc-4022-96cb-cb5b4dcf61d8 is going to be created. [ 915.933875] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.934140] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.934270] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.934537] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.934786] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.935022] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.953887] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: SUCCESS [ 915.954148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.118469] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d32f784a-4b9d-4ad9-8cac-3dcf099fea9c: rpc.has_security_group_logging(os_id): False [ 916.137833] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.137989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.138073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.138293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.138378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.138582] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.138684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.138749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.138906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.138981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.139177] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.139271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.139332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.139474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.139547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.139770] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.139867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.139928] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.140087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.140160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.140243] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be created. [ 916.210659] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.210836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.210923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.211198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.211411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.224736] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: IN_PROGRESS for 2s [ 916.698582] env[66364]: INFO networking_nsxv3.common.synchronization [req-575ac436-5c8d-4b4e-80b2-8381ab3a21bf req-650b32b0-6ac5-4139-b1df-c550c0e6128c service nova] Enqueued Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_rules [ 916.698785] env[66364]: INFO networking_nsxv3.common.synchronization [req-575ac436-5c8d-4b4e-80b2-8381ab3a21bf req-650b32b0-6ac5-4139-b1df-c550c0e6128c service nova] Enqueued Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_members [ 916.698962] env[66364]: INFO networking_nsxv3.common.synchronization [req-575ac436-5c8d-4b4e-80b2-8381ab3a21bf req-650b32b0-6ac5-4139-b1df-c550c0e6128c service nova] Enqueued Resource ID: 004c6b6f-52cc-4022-96cb-cb5b4dcf61d8 with Priority: HIGHEST for action port [ 916.699487] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_rules [ 916.699574] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_members [ 916.699672] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004c6b6f-52cc-4022-96cb-cb5b4dcf61d8 with Priority: HIGHEST for action port [ 916.699945] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-caf65fab-7b8a-4ed0-8b20-496896e11d68 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.700371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.700471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.700669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.700750] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.703267] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-caf65fab-7b8a-4ed0-8b20-496896e11d68 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.703386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.703502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.703634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.704138] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.704276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.704325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.704491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.705500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.705500] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.707068] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.707202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.707500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.707500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.707621] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('004c6b6f-52cc-4022-96cb-cb5b4dcf61d8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.204459] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-caf65fab-7b8a-4ed0-8b20-496896e11d68 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.204821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.207338] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.210713] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 004c6b6f-52cc-4022-96cb-cb5b4dcf61d8 with status ACTIVE [ 917.210928] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.211388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.211388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.211582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.211721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.211945] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.212127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.212239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.212640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.212640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.212924] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.213130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.213235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.213484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.213618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.213763] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 004c6b6f-52cc-4022-96cb-cb5b4dcf61d8 is going to be updated. [ 917.240814] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.240814] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.240814] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.241396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.241579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.241834] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-004c6b6f-52cc-4022-96cb-cb5b4dcf61d8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.479386] env[66364]: INFO networking_nsxv3.common.synchronization [req-51456b6b-b4a3-45ec-a98b-6dbf6604d9bf req-67908f32-ede4-4149-ad6a-d164fc68978a tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 917.482395] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 917.482395] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.482395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.482395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.482395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.482395] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.482395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.482395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.482395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.482395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.482395] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.710682] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.866935] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.867161] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.867630] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.867923] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.868419] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.868631] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.868730] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.868953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.869371] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.869371] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.869473] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.870102] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.870102] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.870102] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 917.870102] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.870102] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.889981] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.890164] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 917.890287] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.890506] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.890778] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.890959] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.891091] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.891571] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.891571] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0805c7fc-ca6e-4b34-86f6-e7b43c5f2748',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.985182] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.985366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.985405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.985600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.985683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.985868] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.985983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.986060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.986206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.986305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.986357] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 918.018558] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.018748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.018835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.019142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.019334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.032267] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 918.214982] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.215589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.215589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.215589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.215589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.215589] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 is going to be created. [ 918.236695] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: SUCCESS [ 918.237059] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.242083] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.242233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.242354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.242518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.242681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.259808] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 in Status: UNINITIALIZED for 2s [ 918.393926] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.394263] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.394398] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.394717] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.394906] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.396006] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 0805c7fc-ca6e-4b34-86f6-e7b43c5f2748 not found, creating... [ 918.396006] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.396006] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.396006] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.396006] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.396006] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.396412] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.396585] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.396707] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.396935] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.397089] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.397240] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 0805c7fc-ca6e-4b34-86f6-e7b43c5f2748 is going to be created. [ 918.418936] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.419277] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.419433] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.419829] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.420146] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.420444] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.126413] env[66364]: INFO networking_nsxv3.common.synchronization [req-51456b6b-b4a3-45ec-a98b-6dbf6604d9bf req-89f397b5-5ada-4789-96e5-c3e2c593d4f7 service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 919.126592] env[66364]: INFO networking_nsxv3.common.synchronization [req-51456b6b-b4a3-45ec-a98b-6dbf6604d9bf req-89f397b5-5ada-4789-96e5-c3e2c593d4f7 service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 919.126743] env[66364]: INFO networking_nsxv3.common.synchronization [req-51456b6b-b4a3-45ec-a98b-6dbf6604d9bf req-89f397b5-5ada-4789-96e5-c3e2c593d4f7 service nova] Enqueued Resource ID: 0805c7fc-ca6e-4b34-86f6-e7b43c5f2748 with Priority: HIGHEST for action port [ 919.127342] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 919.129909] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 919.130088] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0805c7fc-ca6e-4b34-86f6-e7b43c5f2748 with Priority: HIGHEST for action port [ 919.130398] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.130593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.130692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.130909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.130992] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.136444] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.136555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.136781] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.137134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.137697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.137697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.137697] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0805c7fc-ca6e-4b34-86f6-e7b43c5f2748',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.639289] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.639556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.640699] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0805c7fc-ca6e-4b34-86f6-e7b43c5f2748 with status ACTIVE [ 919.640890] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.641033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.641110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.641316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.641405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.641576] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.641675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.641726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.641886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.641962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.642160] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.642255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.642339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.642488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.642565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.642648] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0805c7fc-ca6e-4b34-86f6-e7b43c5f2748 is going to be updated. [ 919.665317] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.665522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.665698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.666100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.666250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.670038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0805c7fc-ca6e-4b34-86f6-e7b43c5f2748" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.043440] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 920.044611] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 920.044611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.044611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.044611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.044611] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.044611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.044611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.044977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.044977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.044977] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.270135] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 in Status: SUCCESS [ 920.270369] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.270507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.270727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.271046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.271158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.271221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.271383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.271465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.271551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.271642] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.548363] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.774339] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.052539] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.277854] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for caf65fab-7b8a-4ed0-8b20-496896e11d68: rpc.has_security_group_logging(os_id): False [ 921.301492] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.301663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.301758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.301993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.302103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.302356] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.302455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.302545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.302705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.302918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.302918] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 is going to be created. [ 921.395481] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.395804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.395804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.396067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.396735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.417794] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 in Status: IN_PROGRESS for 2s [ 921.554714] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.554714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.554714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.554942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.555631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.555631] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 921.595491] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.595668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.595668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.596413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.596413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.607668] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 922.168111] env[66364]: INFO networking_nsxv3.common.synchronization [req-ced3cccc-5a9c-4178-8fa8-c5bbfe47bd75 req-f138854a-e083-42de-a022-d550f943c583 tempest-MigrationsAdminTest-172536833 tempest-MigrationsAdminTest-172536833-project-member] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 922.168111] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGHEST for action security_group_members [ 922.168111] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.168111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.168718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.168718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.168718] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.168718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.168718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.168887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.168887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.169668] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.672390] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.672390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.672390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.672390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.694843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.697027] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.697027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.697027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.697027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.697027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.697027] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 is going to be updated. [ 922.724931] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.727959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.728116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.728237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.728389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.739834] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: IN_PROGRESS for 2s [ 923.435766] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 in Status: SUCCESS [ 923.436194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.620530] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 923.621407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.621713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.622020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.624045] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.624045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.624045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.624045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.624045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.624045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.624045] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.126380] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.126634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.126634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.126943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.127394] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.127394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.127394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.127394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.129079] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.129079] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.129079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.129079] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.360286] env[66364]: INFO networking_nsxv3.common.synchronization [req-e52f6af5-51fe-4dcc-9859-6aa6beff9770 req-7bd37759-88e2-4171-a8db-39318213b632 tempest-ServersTestFqdnHostnames-2079979295 tempest-ServersTestFqdnHostnames-2079979295-project-member] Enqueued Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_members [ 924.360286] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 with Priority: HIGHEST for action security_group_members [ 924.360286] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.360286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.360286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.360286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.360286] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.360286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.360286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.360286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.360906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.361138] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.630591] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e327b378-51f2-4bc5-8b1c-697b0302c4a5: rpc.has_security_group_logging(os_id): False [ 924.652636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.652636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.652636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.652636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.653670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.653670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.653670] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.653670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.653670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.653670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.653670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.653670] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 924.734775] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.734993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.735083] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.735248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.735560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.750767] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 in Status: SUCCESS [ 924.750767] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 deletion is rescheduled due to dependency. [ 924.750767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.753434] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 924.864538] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.864766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.864839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.865169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.865311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.865525] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.865640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.865756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.865916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.866058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.866267] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 is going to be updated. [ 924.906280] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.906446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.906567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.906887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.907046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.928844] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 in Status: IN_PROGRESS for 2s [ 926.112388] env[66364]: INFO networking_nsxv3.common.synchronization [req-6fefcbeb-1c38-4e3d-b703-920bf1d6f87a req-260a9411-aa84-4002-aadb-e0d20e54858b tempest-MultipleCreateTestJSON-1757641290 tempest-MultipleCreateTestJSON-1757641290-project-member] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 926.112932] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 926.113261] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.113404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.113467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.113863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.113958] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.114059] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.114147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.114306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.114393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.114487] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.522299] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.522553] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.522645] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.523014] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.523310] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.523483] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.523572] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.524036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.524036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.524199] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 926.524309] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.524417] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.524522] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.524629] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 926.524736] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.524891] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.548666] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.548903] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 926.548999] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.548999] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.549547] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.549753] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.549894] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.550252] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.550538] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('661f50ce-08dd-4cbf-b4e5-bc853f182b1a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.617276] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.617400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.617400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.618076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.618076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.618076] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.618076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.618076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.618319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.618319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.618319] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 already deleted. [ 926.618405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.769930] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 926.770182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.939683] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 in Status: SUCCESS [ 926.939893] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789 deletion is rescheduled due to dependency. [ 926.940086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.054053] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.054348] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.054348] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.054637] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.054826] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.054970] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 661f50ce-08dd-4cbf-b4e5-bc853f182b1a not found, creating... [ 927.055315] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.055472] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.055722] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.055979] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.056736] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.057139] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.057329] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.057453] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.057713] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.057867] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.058023] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 661f50ce-08dd-4cbf-b4e5-bc853f182b1a is going to be created. [ 927.087387] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.087690] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.087816] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.088132] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.088417] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.088632] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.871371] env[66364]: INFO networking_nsxv3.common.synchronization [req-6fefcbeb-1c38-4e3d-b703-920bf1d6f87a req-a689f02e-b8a6-4947-840b-18d1bc4e7f5b service nova] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_rules [ 927.871637] env[66364]: INFO networking_nsxv3.common.synchronization [req-6fefcbeb-1c38-4e3d-b703-920bf1d6f87a req-a689f02e-b8a6-4947-840b-18d1bc4e7f5b service nova] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 927.871674] env[66364]: INFO networking_nsxv3.common.synchronization [req-6fefcbeb-1c38-4e3d-b703-920bf1d6f87a req-a689f02e-b8a6-4947-840b-18d1bc4e7f5b service nova] Enqueued Resource ID: 661f50ce-08dd-4cbf-b4e5-bc853f182b1a with Priority: HIGHEST for action port [ 927.872236] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_rules [ 927.872374] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 927.872461] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 661f50ce-08dd-4cbf-b4e5-bc853f182b1a with Priority: HIGHEST for action port [ 927.872735] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.872957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.873060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.873339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.873376] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.874849] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.875776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.875776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.875776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.875776] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.875776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.875776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.875776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.876396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.876396] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.876731] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.876907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.876907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.877023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.878283] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('661f50ce-08dd-4cbf-b4e5-bc853f182b1a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.380885] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.381037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.381243] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.382854] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 661f50ce-08dd-4cbf-b4e5-bc853f182b1a with status ACTIVE [ 928.383136] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.383285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.383372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.383662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.383817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.384100] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.384287] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.384346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.384565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.384659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.385036] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.385155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.385233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.385568] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.385651] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.385754] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 661f50ce-08dd-4cbf-b4e5-bc853f182b1a is going to be updated. [ 928.422520] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.423145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.423145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.423638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.423992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.424428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-661f50ce-08dd-4cbf-b4e5-bc853f182b1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.694121] env[66364]: INFO networking_nsxv3.common.synchronization [req-6fefcbeb-1c38-4e3d-b703-920bf1d6f87a req-7cb213f0-48e3-478a-982a-162bc9a2f94c tempest-MultipleCreateTestJSON-1757641290 tempest-MultipleCreateTestJSON-1757641290-project-member] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 928.694665] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 928.694990] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.695109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.888883] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.054033] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.054238] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.054365] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.054683] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.054977] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.055338] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.055465] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.055692] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.055840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.056159] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.056220] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.056280] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.056389] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.056497] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.056602] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.056745] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.077141] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.077334] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 929.077477] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.077678] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.077982] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.078136] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.078262] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.078657] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.078812] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede96e4a-fd93-4b44-b7ed-03abe8ac7d01',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.394925] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.395212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.395309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.395975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.395975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.395975] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be created. [ 929.423146] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.423146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.423146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.423146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.423146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.434992] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: UNINITIALIZED for 2s [ 929.582542] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.582860] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.582927] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.583357] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.583513] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.583673] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port ede96e4a-fd93-4b44-b7ed-03abe8ac7d01 not found, creating... [ 929.584022] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.584191] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.584344] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.584543] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.584685] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.584962] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.586470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.586470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.586470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.586470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.586470] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: ede96e4a-fd93-4b44-b7ed-03abe8ac7d01 is going to be created. [ 929.611717] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.611992] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.612183] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.612539] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.612849] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.613479] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.346130] env[66364]: INFO networking_nsxv3.common.synchronization [req-6fefcbeb-1c38-4e3d-b703-920bf1d6f87a req-6e607890-f141-49fa-a65f-f3fd2aef5437 service nova] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_rules [ 930.346409] env[66364]: INFO networking_nsxv3.common.synchronization [req-6fefcbeb-1c38-4e3d-b703-920bf1d6f87a req-6e607890-f141-49fa-a65f-f3fd2aef5437 service nova] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 930.346493] env[66364]: INFO networking_nsxv3.common.synchronization [req-6fefcbeb-1c38-4e3d-b703-920bf1d6f87a req-6e607890-f141-49fa-a65f-f3fd2aef5437 service nova] Enqueued Resource ID: ede96e4a-fd93-4b44-b7ed-03abe8ac7d01 with Priority: HIGHEST for action port [ 930.347502] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_rules [ 930.347677] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 930.347810] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ede96e4a-fd93-4b44-b7ed-03abe8ac7d01 with Priority: HIGHEST for action port [ 930.348141] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.348276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.348537] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.348701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.348985] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.349204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.349204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.349464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.349464] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede96e4a-fd93-4b44-b7ed-03abe8ac7d01',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.852195] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ede96e4a-fd93-4b44-b7ed-03abe8ac7d01 with status ACTIVE [ 930.852459] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.852617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.852704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.852933] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.853093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.853347] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.853496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.853647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.853899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.854040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.854221] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.854303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.858019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.858019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.858019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.858019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ede96e4a-fd93-4b44-b7ed-03abe8ac7d01 is going to be updated. [ 930.877951] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.877951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.877951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.878153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.878316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.878487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ede96e4a-fd93-4b44-b7ed-03abe8ac7d01" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.166086] env[66364]: INFO networking_nsxv3.common.synchronization [req-c8ec841f-6114-4f09-8b9f-60c05ea0dc39 req-53a22097-bd94-4e8e-b8f7-a9d15e51fdec tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 931.167440] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 931.167900] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.168143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.168507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.168507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.168711] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.172053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.172219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.172437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.172603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.172663] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.447096] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 931.447499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.447841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.448116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.448310] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.448429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.448495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.448655] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.448739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.448817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.449345] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.449731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.449899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.450436] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.450562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.450627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.450768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.451280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.451280] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.570379] env[66364]: INFO networking_nsxv3.common.synchronization [None req-1dca320e-8533-4cbd-88cb-05cfe7f8cc66 None None] Enqueued Resource ID: 53250a9c-83a5-4202-ab8b-6960d0197220 with Priority: HIGHEST for action port [ 931.570962] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53250a9c-83a5-4202-ab8b-6960d0197220 with Priority: HIGHEST for action port [ 931.571349] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-53250a9c-83a5-4202-ab8b-6960d0197220 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.571478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53250a9c-83a5-4202-ab8b-6960d0197220" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.571536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53250a9c-83a5-4202-ab8b-6960d0197220" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.571800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53250a9c-83a5-4202-ab8b-6960d0197220" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.571908] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53250a9c-83a5-4202-ab8b-6960d0197220',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.614029] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-501 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.614029] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.614029] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.614029] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.614029] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.614448] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.614676] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.615010] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.615256] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.615559] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.615788] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.616014] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.616259] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.616492] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.616697] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.618954] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.639368] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.639569] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 931.639707] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.640219] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-501" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.640404] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-54227e60-ae74-41e6-910b-8471becab865 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.640603] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-54227e60-ae74-41e6-910b-8471becab865" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.640790] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-54227e60-ae74-41e6-910b-8471becab865" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.641293] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-54227e60-ae74-41e6-910b-8471becab865" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.641459] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54227e60-ae74-41e6-910b-8471becab865',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.675800] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.676014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.676014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.676268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.677028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.677028] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.677028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.677028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.677250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.677250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.677250] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 931.711903] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.711903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.711903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.711903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.711903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.720118] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 931.953549] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.954933] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.954933] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.078592] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53250a9c-83a5-4202-ab8b-6960d0197220 [ 932.078812] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.079088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.079088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.079246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.079327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.079416] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53250a9c-83a5-4202-ab8b-6960d0197220 already deleted. [ 932.079503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53250a9c-83a5-4202-ab8b-6960d0197220" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.147023] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.147023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.147023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.147023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.147023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.147023] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 54227e60-ae74-41e6-910b-8471becab865 not found, creating... [ 932.147023] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.147023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.147023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.147023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.147023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.147702] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.147702] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.147702] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.147702] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.147702] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.147962] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 54227e60-ae74-41e6-910b-8471becab865 is going to be created. [ 932.199749] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.201021] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.201021] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.201021] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.201395] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.201859] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-54227e60-ae74-41e6-910b-8471becab865" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.292820] env[66364]: INFO networking_nsxv3.common.synchronization [req-d229bfdc-d746-4663-b038-c3c18da59c65 req-28c142ca-65aa-488a-8e87-a04dfc682343 tempest-ServersWithSpecificFlavorTestJSON-596773426 tempest-ServersWithSpecificFlavorTestJSON-596773426-project-member] Enqueued Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 932.294146] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37506c58-083d-46d9-8010-be6545a2e954 with Priority: HIGHEST for action security_group_members [ 932.294566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-37506c58-083d-46d9-8010-be6545a2e954 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.294733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.294824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.295052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.295247] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.295363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.295421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.295601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.295701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.295816] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37506c58-083d-46d9-8010-be6545a2e954',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.459413] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.798082] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.798351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.798461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.798877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.826259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.826259] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.828174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.828174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.828674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.828830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.828952] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37506c58-083d-46d9-8010-be6545a2e954 is going to be updated. [ 932.869519] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.869519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.869519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.869519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.869519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.881123] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: IN_PROGRESS for 2s [ 932.962809] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.962964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.963113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.963359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.963452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.963593] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 932.997293] env[66364]: INFO networking_nsxv3.common.synchronization [req-c8ec841f-6114-4f09-8b9f-60c05ea0dc39 req-89829c62-d3e9-4d1d-94e0-8196c5cf8c7b service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 932.997293] env[66364]: INFO networking_nsxv3.common.synchronization [req-c8ec841f-6114-4f09-8b9f-60c05ea0dc39 req-89829c62-d3e9-4d1d-94e0-8196c5cf8c7b service nova] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 932.997994] env[66364]: INFO networking_nsxv3.common.synchronization [req-c8ec841f-6114-4f09-8b9f-60c05ea0dc39 req-89829c62-d3e9-4d1d-94e0-8196c5cf8c7b service nova] Enqueued Resource ID: 54227e60-ae74-41e6-910b-8471becab865 with Priority: HIGHEST for action port [ 932.998669] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_rules [ 932.999371] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 932.999405] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54227e60-ae74-41e6-910b-8471becab865 with Priority: HIGHEST for action port [ 933.000900] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.000900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.000900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.001105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.001143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.002904] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.002904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.002904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.002904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.002904] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.003934] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.004183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.004405] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-54227e60-ae74-41e6-910b-8471becab865 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.004566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54227e60-ae74-41e6-910b-8471becab865" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.004615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54227e60-ae74-41e6-910b-8471becab865" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.005631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54227e60-ae74-41e6-910b-8471becab865" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.005721] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54227e60-ae74-41e6-910b-8471becab865',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.017269] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 933.145768] env[66364]: INFO networking_nsxv3.common.synchronization [None req-4fe5a7a6-9f41-45f4-9606-bf7faab53e45 tempest-AttachVolumeTestJSON-1194962639 tempest-AttachVolumeTestJSON-1194962639-project-member] Enqueued Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_rules [ 933.146457] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_rules [ 933.146775] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9733c7ac-eb57-4467-8d19-d151daebf568 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.146884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.146962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.149114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.149209] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.296360] env[66364]: INFO networking_nsxv3.common.synchronization [None req-27a637fb-1692-4c4b-97dc-2523bbd26fe9 tempest-AttachVolumeTestJSON-1194962639 tempest-AttachVolumeTestJSON-1194962639-project-member] Enqueued Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_rules [ 933.301304] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_rules [ 933.301304] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9733c7ac-eb57-4467-8d19-d151daebf568 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.301304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.508532] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.508795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.508834] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54227e60-ae74-41e6-910b-8471becab865 with status ACTIVE [ 933.509181] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.509181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.509181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.509393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.509423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.509590] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.510074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.510074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.510074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.510074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.511627] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.511811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.511893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.512666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.512666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.512666] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54227e60-ae74-41e6-910b-8471becab865 is going to be updated. [ 933.538546] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.538706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.538809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.539022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.539191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.539276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54227e60-ae74-41e6-910b-8471becab865" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.685730] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.685730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.685730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.685730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.685730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.685730] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9733c7ac-eb57-4467-8d19-d151daebf568 already deleted. [ 933.685730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.685730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.685730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.685730] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.735494] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 933.735621] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 deletion is rescheduled due to dependency. [ 933.735739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.735916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.736197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.736398] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.736517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.736580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.736786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.736876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.737164] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.168869] env[66364]: INFO networking_nsxv3.common.synchronization [None req-e804556d-1269-4e62-a1a0-d683c2e501ad None None] Enqueued Resource ID: 59f1a9f2-fd73-4de0-87f7-f53bd70be0f8 with Priority: HIGHEST for action port [ 934.168869] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59f1a9f2-fd73-4de0-87f7-f53bd70be0f8 with Priority: HIGHEST for action port [ 934.168869] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-59f1a9f2-fd73-4de0-87f7-f53bd70be0f8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.168869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59f1a9f2-fd73-4de0-87f7-f53bd70be0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.168869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59f1a9f2-fd73-4de0-87f7-f53bd70be0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.170709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59f1a9f2-fd73-4de0-87f7-f53bd70be0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.172023] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59f1a9f2-fd73-4de0-87f7-f53bd70be0f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.215178] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.215428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.215428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.216785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.216785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.216785] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9733c7ac-eb57-4467-8d19-d151daebf568 already deleted. [ 934.216785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.238775] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.673976] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59f1a9f2-fd73-4de0-87f7-f53bd70be0f8 [ 934.674328] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.674392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.674532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.674705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.675266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.675266] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59f1a9f2-fd73-4de0-87f7-f53bd70be0f8 already deleted. [ 934.675266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59f1a9f2-fd73-4de0-87f7-f53bd70be0f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.741854] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.894150] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37506c58-083d-46d9-8010-be6545a2e954 in Status: SUCCESS [ 934.894336] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37506c58-083d-46d9-8010-be6545a2e954 deletion is rescheduled due to dependency. [ 934.894476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37506c58-083d-46d9-8010-be6545a2e954" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.029468] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 935.029468] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.029611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.029884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.030123] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.030285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.030362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.030554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.030666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.030767] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.246978] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.247181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.247257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.247504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.247609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.247766] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 935.281648] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.281841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.281912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.282143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.282295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.294461] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 935.534069] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.036942] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.540150] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.540306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.540375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.540591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.540677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.540770] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 936.572412] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.572553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.572625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.573108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.573450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.583672] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 937.309806] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 937.310721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.310848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.311335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.311569] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.311815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.311815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.311996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.312093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.312156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.312214] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.815056] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.815056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.815056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.815373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.815435] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.815521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.815580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.815731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.815843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.816067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.816146] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.816739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.816739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.816739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.816739] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.816932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.816965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.817184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.817294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.817948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.817948] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.872907] env[66364]: INFO networking_nsxv3.common.synchronization [req-fe611284-69ef-40db-98b0-2fa4a0400a89 req-81bd9d3d-e421-4dd4-964d-da22b45f2ce9 tempest-ServersNegativeTestJSON-73704894 tempest-ServersNegativeTestJSON-73704894-project-member] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 937.874345] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 937.875267] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.875351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.875387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.876169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.876169] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.876169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.876169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.876169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.876169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.877067] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.259036] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.259036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.259036] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.259293] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.260183] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.260183] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.260183] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.260183] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.260790] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.261052] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.262664] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.262664] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.262664] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.262664] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 938.262664] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.262664] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.284613] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.284791] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 938.284970] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.285323] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.285534] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-57f01a96-155c-4451-8919-e9889aee1876 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.285710] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-57f01a96-155c-4451-8919-e9889aee1876" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.287292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-57f01a96-155c-4451-8919-e9889aee1876" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.287292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-57f01a96-155c-4451-8919-e9889aee1876" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.287292] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57f01a96-155c-4451-8919-e9889aee1876',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.321029] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 784e3e36-fad9-4cd6-a173-77329b5f03c2: rpc.has_security_group_logging(os_id): False [ 938.341788] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.342045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.342178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.343025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.343025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.343025] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.343231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.343231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.343425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.343534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.343845] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.343954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.344013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.344178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.344274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.344499] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.344599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.344659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.344817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.344910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.344996] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 938.381354] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.424040] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.424254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.424404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.424777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.424982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.451152] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 938.597765] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 938.598135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.598339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.598681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.598930] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.599121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.599204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.599609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.599609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.599725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.599852] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.599974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.600052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.600250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.600442] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.600571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.600632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.600818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.600906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.600994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.601123] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.790440] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.790640] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.790640] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.791419] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.791419] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.791419] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 57f01a96-155c-4451-8919-e9889aee1876 not found, creating... [ 938.791601] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.791667] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.791792] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.792106] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.792272] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.793105] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.793105] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.793105] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.793105] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.793342] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.793342] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 57f01a96-155c-4451-8919-e9889aee1876 is going to be created. [ 938.820636] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.820808] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.821088] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.821252] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.821488] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.821717] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-57f01a96-155c-4451-8919-e9889aee1876" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.885880] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.103772] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8: rpc.has_security_group_logging(os_id): False [ 939.126446] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.126747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.126853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.127114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.127210] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.127498] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.127608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.127677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.128167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.128167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.128167] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.128330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.128330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.128719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.128719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.128845] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.128908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.128951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.129087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.129158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.129249] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be created. [ 939.185895] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.186093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.186141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.186444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.186584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.198647] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 939.390722] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.390722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.390722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.390722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.390722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.390722] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be updated. [ 939.420973] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.421129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.421214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.421417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.421563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.431475] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: IN_PROGRESS for 2s [ 939.608261] env[66364]: INFO networking_nsxv3.common.synchronization [req-fe611284-69ef-40db-98b0-2fa4a0400a89 req-83b40520-2d5d-44d8-9b31-d75079dece11 service nova] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_rules [ 939.608435] env[66364]: INFO networking_nsxv3.common.synchronization [req-fe611284-69ef-40db-98b0-2fa4a0400a89 req-83b40520-2d5d-44d8-9b31-d75079dece11 service nova] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 939.608575] env[66364]: INFO networking_nsxv3.common.synchronization [req-fe611284-69ef-40db-98b0-2fa4a0400a89 req-83b40520-2d5d-44d8-9b31-d75079dece11 service nova] Enqueued Resource ID: 57f01a96-155c-4451-8919-e9889aee1876 with Priority: HIGHEST for action port [ 939.608947] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_rules [ 939.608947] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 939.609037] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f01a96-155c-4451-8919-e9889aee1876 with Priority: HIGHEST for action port [ 939.609739] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.613023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.613023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.613023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.613023] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.613023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.613023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.613023] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-57f01a96-155c-4451-8919-e9889aee1876 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.613023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57f01a96-155c-4451-8919-e9889aee1876" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.613023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57f01a96-155c-4451-8919-e9889aee1876" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.613023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57f01a96-155c-4451-8919-e9889aee1876" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.613023] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57f01a96-155c-4451-8919-e9889aee1876',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.113804] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.114053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.115505] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57f01a96-155c-4451-8919-e9889aee1876 with status ACTIVE [ 940.115662] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.115932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.115932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.116153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.116260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.116470] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.116576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.116637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.117049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.117049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.117191] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.117191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.117279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.117414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.117457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.117507] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57f01a96-155c-4451-8919-e9889aee1876 is going to be updated. [ 940.142695] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.142988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.143184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.143391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.143591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.143894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57f01a96-155c-4451-8919-e9889aee1876" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.477080] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 940.477080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.214137] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 941.214564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.214564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.214745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.214833] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.270038] env[66364]: INFO networking_nsxv3.common.synchronization [req-032cf215-6f2c-4c47-af4b-84357368c9ee req-617cb046-4bef-4b8b-98f7-b12b7f2ea9ee tempest-MultipleCreateTestJSON-1757641290 tempest-MultipleCreateTestJSON-1757641290-project-member] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 941.271546] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 941.273073] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.273073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.273073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.273073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.273073] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.273073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.273073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.273073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.273411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.273411] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.441782] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: SUCCESS [ 941.442021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.442185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.442409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.442594] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.442708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.442765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.442923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.442996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.443100] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.717158] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.717538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.777821] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.945560] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.965114] env[66364]: INFO networking_nsxv3.common.synchronization [req-9f48c193-7281-4254-b690-1fa8a9de093d req-f9a40f1d-abbf-44ef-a8d0-fd584be2f554 tempest-MultipleCreateTestJSON-1757641290 tempest-MultipleCreateTestJSON-1757641290-project-member] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 941.967243] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 941.967874] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.967874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.128046] env[66364]: INFO networking_nsxv3.common.synchronization [None req-4a0de6af-2716-40ce-9584-689675b011a5 None None] Enqueued Resource ID: 270af8c7-c140-4161-8b12-14a2ea5e4130 with Priority: HIGHEST for action port [ 942.128046] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 270af8c7-c140-4161-8b12-14a2ea5e4130 with Priority: HIGHEST for action port [ 942.128633] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-270af8c7-c140-4161-8b12-14a2ea5e4130 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.128753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-270af8c7-c140-4161-8b12-14a2ea5e4130" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.128823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-270af8c7-c140-4161-8b12-14a2ea5e4130" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.129709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-270af8c7-c140-4161-8b12-14a2ea5e4130" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.129804] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('270af8c7-c140-4161-8b12-14a2ea5e4130',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.280694] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.450194] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.632289] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 270af8c7-c140-4161-8b12-14a2ea5e4130 [ 942.632495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.632612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.632677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.632898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.632999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.633129] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:270af8c7-c140-4161-8b12-14a2ea5e4130 already deleted. [ 942.633212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-270af8c7-c140-4161-8b12-14a2ea5e4130" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.783766] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.783766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.784358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.784358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.784358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.784658] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 942.817507] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.817725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.817802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.818028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.818184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.832053] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 942.954074] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.954074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.954283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.954576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.955496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.955496] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be updated. [ 942.989227] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.989419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.989460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.989672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.989821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.001455] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: IN_PROGRESS for 2s [ 943.544692] env[66364]: INFO networking_nsxv3.common.synchronization [None req-f1b61001-a71b-463a-9a1c-82d7090ba876 None None] Enqueued Resource ID: fd9da000-17da-41e4-be87-565fe2efc492 with Priority: HIGHEST for action port [ 943.545971] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd9da000-17da-41e4-be87-565fe2efc492 with Priority: HIGHEST for action port [ 943.546228] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd9da000-17da-41e4-be87-565fe2efc492 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.546640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd9da000-17da-41e4-be87-565fe2efc492" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.546837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd9da000-17da-41e4-be87-565fe2efc492" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.547200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd9da000-17da-41e4-be87-565fe2efc492" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.547355] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd9da000-17da-41e4-be87-565fe2efc492',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.049938] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd9da000-17da-41e4-be87-565fe2efc492 [ 944.050216] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.050339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.050408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.050622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.050708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.050799] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd9da000-17da-41e4-be87-565fe2efc492 already deleted. [ 944.050875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd9da000-17da-41e4-be87-565fe2efc492" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.423889] env[66364]: INFO networking_nsxv3.common.synchronization [req-62a77916-7414-461c-b2d1-da8fa6e59952 req-ecc54ff7-2c23-4d94-8576-47117cdc80b3 tempest-ServerRescueTestJSON-343135033 tempest-ServerRescueTestJSON-343135033-project-member] Enqueued Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 944.423889] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 944.424108] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.424237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.424340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.424704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.424704] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.426204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.426204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.426204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.426204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.426204] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.844831] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 944.844831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.844831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.844831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.844831] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.844831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.844831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.844831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.844831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.844831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.844831] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.846254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.846508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.846745] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.846943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.847089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.847300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.847455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.847608] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.868116] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.868116] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-588" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.868116] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-588" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.868116] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-588" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.868116] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.868116] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.868116] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.868645] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.868900] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.869242] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.869480] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.869703] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.869907] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.870137] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 944.870368] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.870610] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.890396] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.890396] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 944.890396] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.890396] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-588" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.890730] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-60b55ca6-202f-46eb-82a3-0bd78ccea087 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.891886] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-60b55ca6-202f-46eb-82a3-0bd78ccea087" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.891886] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-60b55ca6-202f-46eb-82a3-0bd78ccea087" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.891886] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-60b55ca6-202f-46eb-82a3-0bd78ccea087" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.892110] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60b55ca6-202f-46eb-82a3-0bd78ccea087',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.927857] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.012376] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: SUCCESS [ 945.012595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.012746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.012958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.013173] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.013291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.013350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.013508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.013590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.013674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.013761] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.133046] env[66364]: INFO networking_nsxv3.common.synchronization [req-f40238db-dc3e-480a-95cd-d58abb3ff240 req-8f7e59df-f583-4663-8ac6-c20329efa61e tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 945.133758] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 945.134472] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.134472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.134472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.134872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.134966] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.135123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.135202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.135398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.135614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.135614] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.349528] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.349528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.353352] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.353352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.353352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.353352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.353352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.353352] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.353352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.353352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.353352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.353352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.353352] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 945.382024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.382173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.382173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.383692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.383692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.396791] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 945.397683] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.397884] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.398014] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.398292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.398440] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.398586] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 60b55ca6-202f-46eb-82a3-0bd78ccea087 not found, creating... [ 945.399710] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.399710] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.399710] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.399710] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.399710] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.399937] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.400085] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.400156] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.400375] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.400486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.400616] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 60b55ca6-202f-46eb-82a3-0bd78ccea087 is going to be created. [ 945.423145] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.423304] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.423520] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.423698] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.424112] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.424362] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-60b55ca6-202f-46eb-82a3-0bd78ccea087" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.430496] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.516293] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.516539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.516634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.516928] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.517130] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.517259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.517316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.517487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.517607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.517703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.517880] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.518028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.518152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.518376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.518562] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.518667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.518746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.518918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.519018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.519126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.519233] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.702505] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.702505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.702505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.702505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.702505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.702505] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.702505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.702505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.702505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.702505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.703025] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 945.739517] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.739517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.739517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.739517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.739517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.748900] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 945.934840] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.934840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.934840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.935119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.935119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.935185] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c is going to be updated. [ 945.965182] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.965182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.965182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.965419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.965498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.976069] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: IN_PROGRESS for 2s [ 946.023801] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d32f784a-4b9d-4ad9-8cac-3dcf099fea9c: rpc.has_security_group_logging(os_id): False [ 946.048398] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.048614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.048663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.048900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.049024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.049290] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.049420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.049497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.049718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.049806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.050391] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.050496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.050496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.051036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.051036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.051219] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.051318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.051378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.051530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.051605] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.051682] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be updated. [ 946.132615] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.132741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.132741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.132969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.133156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.138490] env[66364]: INFO networking_nsxv3.common.synchronization [req-62a77916-7414-461c-b2d1-da8fa6e59952 req-644a5dc2-b892-4095-95ea-2c5317b91f2c service nova] Enqueued Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_rules [ 946.138490] env[66364]: INFO networking_nsxv3.common.synchronization [req-62a77916-7414-461c-b2d1-da8fa6e59952 req-644a5dc2-b892-4095-95ea-2c5317b91f2c service nova] Enqueued Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 946.138490] env[66364]: INFO networking_nsxv3.common.synchronization [req-62a77916-7414-461c-b2d1-da8fa6e59952 req-644a5dc2-b892-4095-95ea-2c5317b91f2c service nova] Enqueued Resource ID: 60b55ca6-202f-46eb-82a3-0bd78ccea087 with Priority: HIGHEST for action port [ 946.138490] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_rules [ 946.138490] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 946.138490] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b55ca6-202f-46eb-82a3-0bd78ccea087 with Priority: HIGHEST for action port [ 946.139090] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.139255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.139304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.139557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.139557] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.141067] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.141334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.141418] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-60b55ca6-202f-46eb-82a3-0bd78ccea087 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.141583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60b55ca6-202f-46eb-82a3-0bd78ccea087" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.141643] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60b55ca6-202f-46eb-82a3-0bd78ccea087" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.141933] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60b55ca6-202f-46eb-82a3-0bd78ccea087" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.142067] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60b55ca6-202f-46eb-82a3-0bd78ccea087',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.152262] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: IN_PROGRESS for 2s [ 946.647525] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60b55ca6-202f-46eb-82a3-0bd78ccea087 with status ACTIVE [ 946.647525] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.647525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.647525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.647525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.647725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.647845] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.648121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.648121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.648261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.648346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.649536] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.649536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.649536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.649536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.649536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.649536] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60b55ca6-202f-46eb-82a3-0bd78ccea087 is going to be updated. [ 946.650456] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.650546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.680242] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.680400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.680445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.680648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.680796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.680936] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60b55ca6-202f-46eb-82a3-0bd78ccea087" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.408348] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 947.408691] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 deletion is rescheduled due to dependency. [ 947.408691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.408793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.409065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.409289] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.409412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.409473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.409634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.409711] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.409788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.409941] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.410045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.410100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.410248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.410469] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.410469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.410580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.410638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.410840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.410840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.410917] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.465664] env[66364]: INFO networking_nsxv3.common.synchronization [None req-56033927-de5c-48fc-834c-5b06006ec749 None None] Enqueued Resource ID: 27b887fd-3e7f-4670-bd38-d5a3dfc73d74 with Priority: HIGHEST for action port [ 947.466209] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b887fd-3e7f-4670-bd38-d5a3dfc73d74 with Priority: HIGHEST for action port [ 947.466565] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-27b887fd-3e7f-4670-bd38-d5a3dfc73d74 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.466625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27b887fd-3e7f-4670-bd38-d5a3dfc73d74" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.466671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27b887fd-3e7f-4670-bd38-d5a3dfc73d74" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.467066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27b887fd-3e7f-4670-bd38-d5a3dfc73d74" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.469618] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27b887fd-3e7f-4670-bd38-d5a3dfc73d74',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.761415] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 947.761596] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 947.761712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.917396] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8: rpc.has_security_group_logging(os_id): False [ 947.930082] env[66364]: INFO networking_nsxv3.common.synchronization [req-869e92f4-8bd7-4e20-be1f-4000f9a33816 req-52fe09c7-2831-4e89-9a14-d72cc8097494 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_members [ 947.930477] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGHEST for action security_group_members [ 947.930998] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6d923ea-108c-4ea6-b072-aa5974291da3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.931300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.931479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.931778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.933829] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.933829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.933829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.933829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.933829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.933829] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.939022] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.939022] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.939022] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.939022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.939603] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.939603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.939603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.939603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.939603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.939603] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 947.974725] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27b887fd-3e7f-4670-bd38-d5a3dfc73d74 [ 947.974725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.974725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.974725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.974725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.974725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.974725] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27b887fd-3e7f-4670-bd38-d5a3dfc73d74 already deleted. [ 947.974725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27b887fd-3e7f-4670-bd38-d5a3dfc73d74" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.985876] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: SUCCESS [ 947.987117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.989128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.989128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.989128] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.989128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.989128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.989128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.989128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.989128] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.011651] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.011651] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.011651] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.012260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.012260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.031809] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 948.169663] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: SUCCESS [ 948.169966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.436583] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.437924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.437924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.437924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.438261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.440170] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.440170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.440170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.440170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.440170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.440170] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6d923ea-108c-4ea6-b072-aa5974291da3 is going to be updated. [ 948.474298] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.474298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.474298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.476102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.476102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.493676] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6d923ea-108c-4ea6-b072-aa5974291da3 in Status: IN_PROGRESS for 2s [ 948.493676] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.995205] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.497537] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.498154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.498154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.498154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.498154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.499449] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c is going to be updated. [ 949.538274] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.539738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.539738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.539738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.539738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.550732] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: IN_PROGRESS for 2s [ 950.046549] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 950.046549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.077567] env[66364]: INFO networking_nsxv3.common.synchronization [req-c9be0507-a2a8-491e-a778-02753b7876ee req-f261895f-bdd8-484e-b8af-3089782542be tempest-AttachVolumeTestJSON-1194962639 tempest-AttachVolumeTestJSON-1194962639-project-member] Enqueued Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_members [ 950.078570] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_members [ 950.078952] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9733c7ac-eb57-4467-8d19-d151daebf568 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.079144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.079228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.079490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.079780] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.081413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.081496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.081655] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.081743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.082009] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.378527] env[66364]: INFO networking_nsxv3.common.synchronization [req-b58545dc-19b4-460d-aa08-1351d43af016 req-34937df5-8ed9-4855-9d7d-201e6ecbb097 tempest-ServersNegativeTestJSON-73704894 tempest-ServersNegativeTestJSON-73704894-project-member] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 950.379172] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 950.380895] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.380895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.380895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.380895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.382177] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.382476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.382598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.382874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.383182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.383250] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.505772] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6d923ea-108c-4ea6-b072-aa5974291da3 in Status: SUCCESS [ 950.506231] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6d923ea-108c-4ea6-b072-aa5974291da3 deletion is rescheduled due to dependency. [ 950.506231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.568188] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-975 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.568188] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-975" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.568188] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-975" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.568188] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-975" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.568188] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.568188] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.569150] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.569631] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.570361] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.570807] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.571068] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.572186] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.572186] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.572186] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.572186] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.572186] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.584628] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.584825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.584892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.585134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.585259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.585481] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.585584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.585647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.585821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.586039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.586235] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9733c7ac-eb57-4467-8d19-d151daebf568 already deleted. [ 950.586235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.592692] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.592868] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 950.593024] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.593201] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-975" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.593501] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.593697] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.593822] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.594289] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.594439] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c9aa63-d4d2-45ce-adbe-583c0f4c0e88',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.650209] env[66364]: INFO networking_nsxv3.common.synchronization [None req-eb8375a4-e2b0-407f-8290-ec5351d2fae2 None None] Enqueued Resource ID: 5d745997-4315-480d-a28c-d9c4965d450d with Priority: HIGHEST for action port [ 950.650209] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d745997-4315-480d-a28c-d9c4965d450d with Priority: HIGHEST for action port [ 950.650209] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d745997-4315-480d-a28c-d9c4965d450d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.652815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d745997-4315-480d-a28c-d9c4965d450d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.653095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d745997-4315-480d-a28c-d9c4965d450d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.653505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d745997-4315-480d-a28c-d9c4965d450d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.653687] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d745997-4315-480d-a28c-d9c4965d450d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.885996] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.101305] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.101470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.101595] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.102082] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.102552] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.102552] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 68c9aa63-d4d2-45ce-adbe-583c0f4c0e88 not found, creating... [ 951.102625] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.102828] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.103019] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.103329] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.103461] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.104201] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.104201] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.104354] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.104711] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.105148] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.107914] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 68c9aa63-d4d2-45ce-adbe-583c0f4c0e88 is going to be created. [ 951.133307] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.133491] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.133556] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.133796] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.134115] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.134365] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.156334] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d745997-4315-480d-a28c-d9c4965d450d [ 951.156466] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.156606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.156733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.156892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.160025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.160025] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d745997-4315-480d-a28c-d9c4965d450d already deleted. [ 951.160025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d745997-4315-480d-a28c-d9c4965d450d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.388513] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.564050] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: SUCCESS [ 951.564050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.564485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.565494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.565494] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.565494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.565494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.565722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.565838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.566065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.566367] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.890165] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.890332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.890487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.890610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.890695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.890844] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be updated. [ 951.894034] env[66364]: INFO networking_nsxv3.common.synchronization [req-c9be0507-a2a8-491e-a778-02753b7876ee req-bf10aef7-f8e6-4a6a-946b-e7443923882c service nova] Enqueued Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_rules [ 951.894034] env[66364]: INFO networking_nsxv3.common.synchronization [req-c9be0507-a2a8-491e-a778-02753b7876ee req-bf10aef7-f8e6-4a6a-946b-e7443923882c service nova] Enqueued Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_members [ 951.894034] env[66364]: INFO networking_nsxv3.common.synchronization [req-c9be0507-a2a8-491e-a778-02753b7876ee req-bf10aef7-f8e6-4a6a-946b-e7443923882c service nova] Enqueued Resource ID: 68c9aa63-d4d2-45ce-adbe-583c0f4c0e88 with Priority: HIGHEST for action port [ 951.895043] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_rules [ 951.895172] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_members [ 951.895172] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68c9aa63-d4d2-45ce-adbe-583c0f4c0e88 with Priority: HIGHEST for action port [ 951.895422] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9733c7ac-eb57-4467-8d19-d151daebf568 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.895529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.895591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.895774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.895846] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.896718] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9733c7ac-eb57-4467-8d19-d151daebf568 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.896811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.896871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.897057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.897199] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.897303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.897355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.897471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.897546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.897637] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.899184] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.899184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.899184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.899184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.899184] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68c9aa63-d4d2-45ce-adbe-583c0f4c0e88',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.928316] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.928316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.928316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.928529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.929091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.943974] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: IN_PROGRESS for 2s [ 952.071409] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.071588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.071666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.071958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.072181] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.072308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.072377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.072539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.072654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.072776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.073130] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.073130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.073217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.073558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.073742] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.073863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.073945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.074141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.074248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.074340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.074428] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.403027] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9733c7ac-eb57-4467-8d19-d151daebf568 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.403027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.403027] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.403027] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68c9aa63-d4d2-45ce-adbe-583c0f4c0e88 with status ACTIVE [ 952.403027] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.403027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.403027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.403027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.403027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.403027] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.403027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.403027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.403027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.403027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.403708] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.403915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.404110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.404343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.404510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.404679] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68c9aa63-d4d2-45ce-adbe-583c0f4c0e88 is going to be updated. [ 952.430987] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.430987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.430987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.430987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.430987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.431193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68c9aa63-d4d2-45ce-adbe-583c0f4c0e88" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.579450] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 779e6414-54c4-4ab2-8678-8a31896ce93c: rpc.has_security_group_logging(os_id): False [ 952.604026] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.604026] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.604026] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.604026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.604670] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.604670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.604670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.604948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.605187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.605374] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c is going to be updated. [ 952.695231] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.695471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.695471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.695671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.695791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.714218] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: IN_PROGRESS for 2s [ 952.853358] env[66364]: INFO networking_nsxv3.common.synchronization [req-78ce2f8f-6298-4dc3-8277-2e4a0319a928 req-032087f1-7054-4e34-aab6-15f0c40b6e8c tempest-ServersV294TestFqdnHostnames-649041268 tempest-ServersV294TestFqdnHostnames-649041268-project-member] Enqueued Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_members [ 952.854355] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd with Priority: HIGHEST for action security_group_members [ 952.855405] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc73d65-12db-4adf-90af-f7bd6b67d4fd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.855405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.855405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.855620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.856352] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.856352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.856352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.856352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.856654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.856654] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edc73d65-12db-4adf-90af-f7bd6b67d4fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.910343] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.362094] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.362094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.362094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.362094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.362094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.362094] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.362094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.362094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.362094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.362094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.362094] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd is going to be updated. [ 953.391792] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.391792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.392527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.392527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.392527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.406169] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd in Status: IN_PROGRESS for 2s [ 953.416904] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.417302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.417352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.417564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.417651] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.417748] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9733c7ac-eb57-4467-8d19-d151daebf568 is going to be created. [ 953.446694] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.446694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.446694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.446694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.446694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.458614] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9733c7ac-eb57-4467-8d19-d151daebf568 in Status: UNINITIALIZED for 2s [ 953.955549] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: SUCCESS [ 953.955820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.730392] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: SUCCESS [ 954.730392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.419616] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd in Status: SUCCESS [ 955.419616] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc73d65-12db-4adf-90af-f7bd6b67d4fd deletion is rescheduled due to dependency. [ 955.419616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc73d65-12db-4adf-90af-f7bd6b67d4fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.471494] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9733c7ac-eb57-4467-8d19-d151daebf568 in Status: SUCCESS [ 955.471819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.472088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.472378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.472640] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.472792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.473070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.473185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.473285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.473399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.473538] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.976544] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.034551] env[66364]: INFO networking_nsxv3.common.synchronization [None req-524fb2dc-e6ef-4f34-abed-17313d26c77d None None] Enqueued Resource ID: 89e72f2b-87d4-4e4c-a203-6a5b9baca911 with Priority: HIGHEST for action port [ 956.037035] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89e72f2b-87d4-4e4c-a203-6a5b9baca911 with Priority: HIGHEST for action port [ 956.037035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-89e72f2b-87d4-4e4c-a203-6a5b9baca911 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.037035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89e72f2b-87d4-4e4c-a203-6a5b9baca911" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.037035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89e72f2b-87d4-4e4c-a203-6a5b9baca911" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.037457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89e72f2b-87d4-4e4c-a203-6a5b9baca911" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.037583] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e72f2b-87d4-4e4c-a203-6a5b9baca911',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.284057] env[66364]: INFO networking_nsxv3.common.synchronization [req-0d651b1a-9981-4756-a80e-502b29b724bf req-9c960d6b-3b1d-4aa4-82ce-9f4ff467e118 tempest-ImagesTestJSON-466108225 tempest-ImagesTestJSON-466108225-project-member] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 956.285661] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGHEST for action security_group_members [ 956.285661] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.285661] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.285661] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.285661] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.285661] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.285973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.285973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.286048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.286097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.286184] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.478604] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9733c7ac-eb57-4467-8d19-d151daebf568: rpc.has_security_group_logging(os_id): False [ 956.500373] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.500619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.500619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.500827] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.500944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.501238] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.501405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.501405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.501590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.501590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.501704] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9733c7ac-eb57-4467-8d19-d151daebf568 is going to be created. [ 956.541255] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89e72f2b-87d4-4e4c-a203-6a5b9baca911 [ 956.541255] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.541255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.541255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.541255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.541255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.542259] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89e72f2b-87d4-4e4c-a203-6a5b9baca911 already deleted. [ 956.542259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89e72f2b-87d4-4e4c-a203-6a5b9baca911" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.565348] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.565572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.565572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.567378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.567378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.579796] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9733c7ac-eb57-4467-8d19-d151daebf568 in Status: IN_PROGRESS for 2s [ 956.789328] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.789611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.789681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.789936] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.790061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.790292] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.790391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.790449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.790616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.790693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.790778] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be updated. [ 956.830754] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.830754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.830754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.830754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.830754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.841255] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: IN_PROGRESS for 2s [ 957.627621] env[66364]: INFO networking_nsxv3.common.synchronization [req-f8f99d3a-bd16-40a6-8e5e-ba8c6e63fc99 req-106f1faa-841f-49e4-8b6b-edbe91cd2164 tempest-AttachVolumeShelveTestJSON-446961995 tempest-AttachVolumeShelveTestJSON-446961995-project-member] Enqueued Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_members [ 957.628217] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0345151-3287-4add-b6b3-bbb72460c6bd with Priority: HIGHEST for action security_group_members [ 957.628526] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0345151-3287-4add-b6b3-bbb72460c6bd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.628677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.628722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.628895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.629261] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.629458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.629569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.629794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.629927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.630068] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0345151-3287-4add-b6b3-bbb72460c6bd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.133064] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.133294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.133294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.133549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.133671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.134119] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.134119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.134119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.134289] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.134382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.134569] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0345151-3287-4add-b6b3-bbb72460c6bd is going to be updated. [ 958.162906] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.163074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.163152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.163523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.163728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.174299] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: IN_PROGRESS for 2s [ 958.594673] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9733c7ac-eb57-4467-8d19-d151daebf568 in Status: SUCCESS [ 958.594673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.854768] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 in Status: SUCCESS [ 958.855104] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 deletion is rescheduled due to dependency. [ 958.855648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.185097] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0345151-3287-4add-b6b3-bbb72460c6bd in Status: SUCCESS [ 960.185382] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0345151-3287-4add-b6b3-bbb72460c6bd deletion is rescheduled due to dependency. [ 960.185435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0345151-3287-4add-b6b3-bbb72460c6bd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.239982] env[66364]: INFO networking_nsxv3.common.synchronization [req-0371813b-8888-4feb-9209-4f3d6a9cd671 req-09616467-2048-4022-b988-cdce1ab59589 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 960.239982] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 960.239982] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.239982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.239982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.244057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.244773] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.244773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.244773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.247129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.247129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.247129] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.367348] env[66364]: INFO networking_nsxv3.common.synchronization [req-9bd09864-68fd-4d63-8532-6521eca0abf6 req-fcdc19c3-0808-4c2d-aa5a-14445e530525 tempest-ServerMetadataTestJSON-1581853261 tempest-ServerMetadataTestJSON-1581853261-project-member] Enqueued Resource ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb with Priority: HIGHEST for action security_group_members [ 960.368306] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb with Priority: HIGHEST for action security_group_members [ 960.368791] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.371254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.371254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.371254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.371254] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.371254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.371254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.371254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.371254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.371254] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb1df802-a3f1-4c8d-a6da-037dbf31eedb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.645906] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.646179] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.646315] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.646607] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.647214] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.647214] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.647214] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.647510] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.647677] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.648500] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.648500] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.648500] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.648500] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.648500] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.648663] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.648753] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.673061] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.673061] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 960.673061] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.673061] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.673061] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-4411719f-b406-47d2-a020-1a8fd6716b0f taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.673061] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-4411719f-b406-47d2-a020-1a8fd6716b0f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.673061] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-4411719f-b406-47d2-a020-1a8fd6716b0f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.673061] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-4411719f-b406-47d2-a020-1a8fd6716b0f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.673061] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4411719f-b406-47d2-a020-1a8fd6716b0f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.746574] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.746716] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-774" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.746818] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-774" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.747166] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-774" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.747433] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.747592] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.747705] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.747939] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.748115] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.748316] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.748425] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 960.748529] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 960.748631] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 960.748734] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 960.748836] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 960.748962] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 960.750379] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.750490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.750556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.750706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.750784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.750958] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.751097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.751161] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.751305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.751378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.751460] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c already deleted. [ 960.751536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.769429] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 960.769612] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 960.769960] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 960.769960] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-774" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.770309] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-7c2586bb-a7b7-44b3-9123-4869e176dfa7 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.770481] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-7c2586bb-a7b7-44b3-9123-4869e176dfa7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.770594] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-7c2586bb-a7b7-44b3-9123-4869e176dfa7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.770898] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-7c2586bb-a7b7-44b3-9123-4869e176dfa7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.771189] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c2586bb-a7b7-44b3-9123-4869e176dfa7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.873843] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.874126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.874210] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.874465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.874573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.874849] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.874994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.875067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.875315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.875417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.875558] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb already deleted. [ 960.875699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.178315] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.178532] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.178660] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.178962] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.179135] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.179290] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 4411719f-b406-47d2-a020-1a8fd6716b0f not found, creating... [ 961.179559] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.179779] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.179871] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.180058] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.180201] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.182168] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.182348] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.182467] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.182677] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.182808] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.182946] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 4411719f-b406-47d2-a020-1a8fd6716b0f is going to be created. [ 961.202921] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.203344] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.203344] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.203492] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.203710] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.203921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-4411719f-b406-47d2-a020-1a8fd6716b0f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.273652] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.273865] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.274028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.274325] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.274491] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.274621] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 7c2586bb-a7b7-44b3-9123-4869e176dfa7 not found, creating... [ 961.274890] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.275057] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.275187] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.275404] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.275531] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.275799] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.275936] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.276060] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.276263] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.276385] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.276513] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 7c2586bb-a7b7-44b3-9123-4869e176dfa7 is going to be created. [ 961.298656] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.298888] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.298972] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.299261] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.299538] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.299834] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-7c2586bb-a7b7-44b3-9123-4869e176dfa7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.943163] env[66364]: INFO networking_nsxv3.common.synchronization [req-0371813b-8888-4feb-9209-4f3d6a9cd671 req-cd581d44-0d32-45fb-a72e-f7256f23b8ea service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 961.943163] env[66364]: INFO networking_nsxv3.common.synchronization [req-0371813b-8888-4feb-9209-4f3d6a9cd671 req-cd581d44-0d32-45fb-a72e-f7256f23b8ea service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 961.943163] env[66364]: INFO networking_nsxv3.common.synchronization [req-0371813b-8888-4feb-9209-4f3d6a9cd671 req-cd581d44-0d32-45fb-a72e-f7256f23b8ea service nova] Enqueued Resource ID: 4411719f-b406-47d2-a020-1a8fd6716b0f with Priority: HIGHEST for action port [ 961.943163] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 961.943163] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 961.943163] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4411719f-b406-47d2-a020-1a8fd6716b0f with Priority: HIGHEST for action port [ 961.943163] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.943163] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.943163] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.943163] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.943163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.944495] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.944495] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-4411719f-b406-47d2-a020-1a8fd6716b0f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.944495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4411719f-b406-47d2-a020-1a8fd6716b0f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.944495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4411719f-b406-47d2-a020-1a8fd6716b0f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.944495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4411719f-b406-47d2-a020-1a8fd6716b0f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.944495] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4411719f-b406-47d2-a020-1a8fd6716b0f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.017965] env[66364]: INFO networking_nsxv3.common.synchronization [req-9bd09864-68fd-4d63-8532-6521eca0abf6 req-4c6c43c3-9174-4a49-a62a-a035f52f253b service nova] Enqueued Resource ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb with Priority: HIGHEST for action security_group_rules [ 962.018072] env[66364]: INFO networking_nsxv3.common.synchronization [req-9bd09864-68fd-4d63-8532-6521eca0abf6 req-4c6c43c3-9174-4a49-a62a-a035f52f253b service nova] Enqueued Resource ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb with Priority: HIGHEST for action security_group_members [ 962.018274] env[66364]: INFO networking_nsxv3.common.synchronization [req-9bd09864-68fd-4d63-8532-6521eca0abf6 req-4c6c43c3-9174-4a49-a62a-a035f52f253b service nova] Enqueued Resource ID: 7c2586bb-a7b7-44b3-9123-4869e176dfa7 with Priority: HIGHEST for action port [ 962.019072] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb with Priority: HIGHEST for action security_group_rules [ 962.019072] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb with Priority: HIGHEST for action security_group_members [ 962.019072] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2586bb-a7b7-44b3-9123-4869e176dfa7 with Priority: HIGHEST for action port [ 962.019354] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb1df802-a3f1-4c8d-a6da-037dbf31eedb taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.019432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.019471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.020541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.020541] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb1df802-a3f1-4c8d-a6da-037dbf31eedb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.021825] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.022743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.022743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.022743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.022743] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.023662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.023662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.023662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.023857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.023857] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb1df802-a3f1-4c8d-a6da-037dbf31eedb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.024963] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c2586bb-a7b7-44b3-9123-4869e176dfa7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.024963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c2586bb-a7b7-44b3-9123-4869e176dfa7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.024963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c2586bb-a7b7-44b3-9123-4869e176dfa7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.026334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c2586bb-a7b7-44b3-9123-4869e176dfa7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.026334] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c2586bb-a7b7-44b3-9123-4869e176dfa7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.436791] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.439129] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.439129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.439129] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4411719f-b406-47d2-a020-1a8fd6716b0f with status ACTIVE [ 962.439129] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.439129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.439129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.439129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.439129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.439504] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.439504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.439504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.439606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.439606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.442744] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.442744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.442744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.442744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.442744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.442744] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4411719f-b406-47d2-a020-1a8fd6716b0f is going to be updated. [ 962.464938] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.464938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.464938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.464938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.464938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.464938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4411719f-b406-47d2-a020-1a8fd6716b0f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.528091] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb1df802-a3f1-4c8d-a6da-037dbf31eedb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.529239] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.529456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.529648] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c2586bb-a7b7-44b3-9123-4869e176dfa7 with status ACTIVE [ 962.529810] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.529917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.529982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.530198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.530280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.530443] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.530558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.531786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.531786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.531786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.531786] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.531786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.531786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.531786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.531786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.531786] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c2586bb-a7b7-44b3-9123-4869e176dfa7 is going to be updated. [ 962.552080] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.552257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.552330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.552600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.552744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.552906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c2586bb-a7b7-44b3-9123-4869e176dfa7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.939019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.035333] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb1df802-a3f1-4c8d-a6da-037dbf31eedb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.441081] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.441502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.441502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.441502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.441621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.441697] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be created. [ 963.468523] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.469114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.469114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.469114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.469264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.479674] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: UNINITIALIZED for 2s [ 963.537574] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.537735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.537735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.538686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.538686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.538686] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb is going to be created. [ 963.566754] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.566998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.567074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.567335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.568086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.578159] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb in Status: UNINITIALIZED for 2s [ 965.490125] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 965.490524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.490524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.490617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.491111] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.491111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.491111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.491329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.491329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.491500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.491500] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.587039] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb in Status: SUCCESS [ 965.587206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.587362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.587577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.587767] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.587879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.587942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.588111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.588195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.588277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.588365] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb1df802-a3f1-4c8d-a6da-037dbf31eedb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.994666] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.994937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.995120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.995447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.995720] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.995892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.996024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.996339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.996468] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.996566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.996732] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.996826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.996889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.997100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.997263] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.997370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.997511] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.997808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.997808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.997808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.997954] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.090298] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.090456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.090550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.090838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.091071] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.091233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.091297] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.091467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.091558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.091642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.091792] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.091908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.091950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.092086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.092222] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.092309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.092365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.092498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.092573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.092652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.092736] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb1df802-a3f1-4c8d-a6da-037dbf31eedb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.500403] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 622b5ca5-0010-4122-b9d4-901a52d1aa5c: rpc.has_security_group_logging(os_id): False [ 966.525642] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.525875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.525875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.526123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.526214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.526509] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.526740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.526801] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.526983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.527087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.527338] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.527543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.527543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.527649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.527722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.527980] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.528169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.528274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.528492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.528594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.528685] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be created. [ 966.594608] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb1df802-a3f1-4c8d-a6da-037dbf31eedb: rpc.has_security_group_logging(os_id): False [ 966.608329] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.608329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.608329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.608329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.608329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.616236] env[66364]: INFO networking_nsxv3.common.synchronization [req-a6e18b47-6096-4084-be7a-966f01b3c53f req-ee1f2049-feae-4b61-b70b-d8770f9aef69 tempest-AttachInterfacesV270Test-1631680532 tempest-AttachInterfacesV270Test-1631680532-project-member] Enqueued Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGHEST for action security_group_members [ 966.616236] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGHEST for action security_group_members [ 966.616236] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.616467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.616467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.616657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.616811] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.616921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.616983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.617136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.617216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.617302] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c98b6c22-a778-4b7a-8143-b67c9c0e3eef',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.619203] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.619359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.619431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.619619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.619619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.619790] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.619881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.619966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.620098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.620373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.620373] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.620450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.621202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.621202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.621202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.621202] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.621202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.621202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.621202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.621541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.621541] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb is going to be created. [ 966.623712] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 966.686382] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.686569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.686627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.686793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.686976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.703510] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb in Status: IN_PROGRESS for 2s [ 967.127351] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.127351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.127351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.127351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.127351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.127351] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.127351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.127351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.127351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.127351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.127351] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef already deleted. [ 967.127351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.519442] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-211 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.519442] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-211" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.519442] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-211" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.521308] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-211" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.524167] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.524167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.524167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.524167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.524167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.524167] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.524167] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 967.524167] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 967.524167] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 967.524167] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 967.524167] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 967.524167] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 967.549637] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 967.550613] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 967.550613] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 967.550613] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-211" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.550613] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.550917] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.551068] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.551486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.551707] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd5f548-ff52-4d72-a8fa-82501b95f5c5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.056480] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.056780] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.056960] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.057342] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.057551] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.057765] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port cfd5f548-ff52-4d72-a8fa-82501b95f5c5 not found, creating... [ 968.058144] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.058365] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.058531] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.058833] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.059046] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.059534] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.060117] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.060117] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.060229] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.060445] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.060642] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: cfd5f548-ff52-4d72-a8fa-82501b95f5c5 is going to be created. [ 968.091706] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.092024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.092175] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.092449] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.092671] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.093083] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.641261] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 968.641661] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.719402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb in Status: SUCCESS [ 968.719854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.846890] env[66364]: INFO networking_nsxv3.common.synchronization [req-a6e18b47-6096-4084-be7a-966f01b3c53f req-4cecfa66-6fb2-4e2b-8719-b77a7dfe1d63 service nova] Enqueued Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGHEST for action security_group_rules [ 968.847037] env[66364]: INFO networking_nsxv3.common.synchronization [req-a6e18b47-6096-4084-be7a-966f01b3c53f req-4cecfa66-6fb2-4e2b-8719-b77a7dfe1d63 service nova] Enqueued Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGHEST for action security_group_members [ 968.847131] env[66364]: INFO networking_nsxv3.common.synchronization [req-a6e18b47-6096-4084-be7a-966f01b3c53f req-4cecfa66-6fb2-4e2b-8719-b77a7dfe1d63 service nova] Enqueued Resource ID: cfd5f548-ff52-4d72-a8fa-82501b95f5c5 with Priority: HIGHEST for action port [ 968.847671] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGHEST for action security_group_rules [ 968.847798] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGHEST for action security_group_members [ 968.847914] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfd5f548-ff52-4d72-a8fa-82501b95f5c5 with Priority: HIGHEST for action port [ 968.848970] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.848970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.848970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.849330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.849330] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c98b6c22-a778-4b7a-8143-b67c9c0e3eef',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.850261] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.850425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.850425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.850638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.851515] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.851604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.851604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.851873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.852046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.852144] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c98b6c22-a778-4b7a-8143-b67c9c0e3eef',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.853708] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.853820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.853887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.854172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.854266] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfd5f548-ff52-4d72-a8fa-82501b95f5c5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.358410] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.358410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.358750] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c98b6c22-a778-4b7a-8143-b67c9c0e3eef',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.360032] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfd5f548-ff52-4d72-a8fa-82501b95f5c5 with status ACTIVE [ 969.361052] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.361052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.361052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.361255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.361530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.361775] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.361958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.362067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.362548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.362548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.362870] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.363165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.363285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.365359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.365359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.365359] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfd5f548-ff52-4d72-a8fa-82501b95f5c5 is going to be updated. [ 969.399590] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.399773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.399846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.400106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.400257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.400435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfd5f548-ff52-4d72-a8fa-82501b95f5c5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.867141] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c98b6c22-a778-4b7a-8143-b67c9c0e3eef',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.368961] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.369056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.369131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.369337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.369420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.369512] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef is going to be created. [ 970.396565] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.396565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.396565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.397069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.397069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.410956] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef in Status: UNINITIALIZED for 2s [ 972.423340] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef in Status: SUCCESS [ 972.423749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.423749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.423941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.424217] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.424354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.424415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.424569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.424653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.424737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.424827] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c98b6c22-a778-4b7a-8143-b67c9c0e3eef',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.928131] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.928131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.928131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.928131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.928131] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.928467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.928467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.928728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.928728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.928728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.928920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.928920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.928920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.929131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.929212] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.929305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.929360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.929520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.929566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.929636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.929765] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c98b6c22-a778-4b7a-8143-b67c9c0e3eef',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.332178] env[66364]: INFO networking_nsxv3.common.synchronization [req-87c74961-24a9-4b11-8f66-3cade9c6d951 req-955f8f31-c02d-41cd-83bd-78d75d13f410 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_members [ 973.332832] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGHEST for action security_group_members [ 973.333124] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.333291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.333291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.333749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.333749] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.333749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.333749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.334044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.334044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.334044] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.434459] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c98b6c22-a778-4b7a-8143-b67c9c0e3eef: rpc.has_security_group_logging(os_id): False [ 973.455137] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.455329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.455633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.455633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.455775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.456930] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.457955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.457955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.457955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.457955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.457955] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.457955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.457955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.458356] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.458356] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.458431] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.458653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.458653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.458749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.458799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.458875] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef is going to be created. [ 973.524380] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.526656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.526656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.526656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.526656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.537719] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef in Status: IN_PROGRESS for 2s [ 973.750591] env[66364]: INFO networking_nsxv3.common.synchronization [None req-a5b140b3-9fcc-4c52-9bf7-2c3a2982114a None None] Enqueued Resource ID: 7b2c2bd1-f316-4688-9287-ee920aafa161 with Priority: HIGHEST for action port [ 973.754013] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b2c2bd1-f316-4688-9287-ee920aafa161 with Priority: HIGHEST for action port [ 973.754013] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b2c2bd1-f316-4688-9287-ee920aafa161 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.754013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b2c2bd1-f316-4688-9287-ee920aafa161" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.754013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b2c2bd1-f316-4688-9287-ee920aafa161" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.754013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b2c2bd1-f316-4688-9287-ee920aafa161" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.754013] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b2c2bd1-f316-4688-9287-ee920aafa161',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.839032] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.839032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.839032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.839032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.865669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.865669] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.865669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.865669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.865669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.865669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.865669] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 is going to be updated. [ 973.919771] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.926045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.926045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.926045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.926045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.935746] env[66364]: INFO networking_nsxv3.common.synchronization [req-e1244317-25dd-4696-aaa7-385f4532394c req-cd792186-4814-49fa-a58d-6cea6a706d91 tempest-ServerRescueTestJSON-343135033 tempest-ServerRescueTestJSON-343135033-project-member] Enqueued Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 973.937881] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 973.938139] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.938139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.938260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.938417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.938580] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.938683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.938742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.938900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.938987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.939100] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.943136] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 in Status: IN_PROGRESS for 2s [ 974.259042] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b2c2bd1-f316-4688-9287-ee920aafa161 [ 974.259042] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.259042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.259042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.259042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.259042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.259643] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b2c2bd1-f316-4688-9287-ee920aafa161 already deleted. [ 974.259643] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b2c2bd1-f316-4688-9287-ee920aafa161" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.442503] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.946210] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.384237] env[66364]: INFO networking_nsxv3.common.synchronization [req-fcdec241-95fa-4dca-95ce-3570038e9aff req-35f769e4-9fa1-4a53-9a8a-0246ee93c932 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 975.384862] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 975.384966] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.385220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.385220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.385402] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.385582] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.386041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.386116] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.386319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.386380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.386462] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.450521] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.450880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.450880] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.451176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.451309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.451486] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c is going to be updated. [ 975.492735] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.493226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.493397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.493561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.493726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.509127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: IN_PROGRESS for 2s [ 975.551139] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef in Status: SUCCESS [ 975.551139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.889019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.889368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.889368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.889616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.889750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.892130] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.892130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.892130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.892130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.892130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.892130] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 975.921371] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.921371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.921567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.921674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.921838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.927255] env[66364]: INFO networking_nsxv3.common.synchronization [req-dca7f742-840c-4dac-9502-fa834ecf2edb req-85d661f8-f376-4fd8-a33c-ed8aac05b6e9 tempest-MultipleCreateTestJSON-1757641290 tempest-MultipleCreateTestJSON-1757641290-project-member] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 975.927773] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 975.928157] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.928365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.928365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.928548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.928705] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.928799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.928861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.929015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.929106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.929204] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.934824] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 975.954061] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 in Status: SUCCESS [ 975.954061] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 deletion is rescheduled due to dependency. [ 975.954061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.131329] env[66364]: INFO networking_nsxv3.common.synchronization [req-9f58457c-b0e8-4409-aad6-777978f542e1 req-f795fc2c-601b-462d-bbe0-c1f141354ef9 tempest-ServerMetadataTestJSON-1581853261 tempest-ServerMetadataTestJSON-1581853261-project-member] Enqueued Resource ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb with Priority: HIGHEST for action security_group_members [ 976.131329] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb with Priority: HIGHEST for action security_group_members [ 976.131329] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.131636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.131636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.131751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.132633] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.132998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.133286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.133650] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.133903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.134375] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb1df802-a3f1-4c8d-a6da-037dbf31eedb',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.406646] env[66364]: INFO networking_nsxv3.common.synchronization [None req-e7a6286c-76b8-4570-85b6-24f91697cf63 None None] Enqueued Resource ID: 94a8d9d8-c8bd-4f1e-9274-411ab90a26f8 with Priority: HIGHEST for action port [ 976.408259] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a8d9d8-c8bd-4f1e-9274-411ab90a26f8 with Priority: HIGHEST for action port [ 976.409890] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-94a8d9d8-c8bd-4f1e-9274-411ab90a26f8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.410068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94a8d9d8-c8bd-4f1e-9274-411ab90a26f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.410164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94a8d9d8-c8bd-4f1e-9274-411ab90a26f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.410471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94a8d9d8-c8bd-4f1e-9274-411ab90a26f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.410619] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a8d9d8-c8bd-4f1e-9274-411ab90a26f8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.435924] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.436083] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.436151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.436370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.436457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.436659] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.436753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.437114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.437330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.437412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.437490] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 976.467608] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.467911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.467911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.468217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.468271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.483504] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 976.538582] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.538850] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.538979] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.539285] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.539558] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.539715] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.539829] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.540169] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.540347] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.540743] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.540872] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.541077] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.541210] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.541423] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.541652] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.541899] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.567585] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.567757] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.567880] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.568196] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.568490] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-b6042078-6d6e-4a60-9c43-a57570795996 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.568782] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-b6042078-6d6e-4a60-9c43-a57570795996" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.568782] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-b6042078-6d6e-4a60-9c43-a57570795996" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.569203] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-b6042078-6d6e-4a60-9c43-a57570795996" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.569311] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6042078-6d6e-4a60-9c43-a57570795996',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.636837] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.637122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.637122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.637306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.637403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.637624] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.637704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.637754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.637909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.637984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.638082] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb is going to be updated. [ 976.675363] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.676128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.676128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.676128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.676128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.689052] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb in Status: IN_PROGRESS for 2s [ 976.917317] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94a8d9d8-c8bd-4f1e-9274-411ab90a26f8 [ 976.917317] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.917317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.917317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.917317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.917317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.917317] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94a8d9d8-c8bd-4f1e-9274-411ab90a26f8 already deleted. [ 976.917317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94a8d9d8-c8bd-4f1e-9274-411ab90a26f8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.072859] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.073102] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.073233] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.073535] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.073694] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.073917] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port b6042078-6d6e-4a60-9c43-a57570795996 not found, creating... [ 977.074330] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.074567] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.074695] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.074980] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.075217] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.075524] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.075686] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.075840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.076026] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.076167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.076308] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: b6042078-6d6e-4a60-9c43-a57570795996 is going to be created. [ 977.099720] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.099930] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.100064] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.100358] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.100591] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.100809] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-b6042078-6d6e-4a60-9c43-a57570795996" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.521203] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: SUCCESS [ 977.521518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.853991] env[66364]: INFO networking_nsxv3.common.synchronization [req-dca7f742-840c-4dac-9502-fa834ecf2edb req-f77a6858-f8d3-422d-93f5-b9dcb88c68cb service nova] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_rules [ 977.853991] env[66364]: INFO networking_nsxv3.common.synchronization [req-dca7f742-840c-4dac-9502-fa834ecf2edb req-f77a6858-f8d3-422d-93f5-b9dcb88c68cb service nova] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 977.853991] env[66364]: INFO networking_nsxv3.common.synchronization [req-dca7f742-840c-4dac-9502-fa834ecf2edb req-f77a6858-f8d3-422d-93f5-b9dcb88c68cb service nova] Enqueued Resource ID: b6042078-6d6e-4a60-9c43-a57570795996 with Priority: HIGHEST for action port [ 977.853991] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_rules [ 977.853991] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 977.853991] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6042078-6d6e-4a60-9c43-a57570795996 with Priority: HIGHEST for action port [ 977.853991] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.853991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.853991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.853991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.853991] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.855316] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.855755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.855978] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6042078-6d6e-4a60-9c43-a57570795996 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.856110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6042078-6d6e-4a60-9c43-a57570795996" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.856152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6042078-6d6e-4a60-9c43-a57570795996" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.856362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6042078-6d6e-4a60-9c43-a57570795996" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.856436] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6042078-6d6e-4a60-9c43-a57570795996',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.945712] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 977.946025] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c deletion is rescheduled due to dependency. [ 977.946214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.355648] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.355788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.358653] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6042078-6d6e-4a60-9c43-a57570795996 with status ACTIVE [ 978.358653] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.358653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.358802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.359692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.359692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.359692] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.359692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.359692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.359692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.359692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.359971] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.359971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.359971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.360175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.360175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.360175] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6042078-6d6e-4a60-9c43-a57570795996 is going to be updated. [ 978.382394] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.382546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.382615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.382829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.382971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.383161] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6042078-6d6e-4a60-9c43-a57570795996" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.494434] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 978.494633] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 deletion is rescheduled due to dependency. [ 978.495262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.495262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.495262] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.495533] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.495594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.495638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.495966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.495966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.496081] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.710262] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb in Status: SUCCESS [ 978.710635] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb1df802-a3f1-4c8d-a6da-037dbf31eedb deletion is rescheduled due to dependency. [ 978.710635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb1df802-a3f1-4c8d-a6da-037dbf31eedb" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.987939] env[66364]: INFO networking_nsxv3.common.synchronization [req-dca7f742-840c-4dac-9502-fa834ecf2edb req-ef172656-e415-4a74-b977-46cb18e8a516 tempest-MultipleCreateTestJSON-1757641290 tempest-MultipleCreateTestJSON-1757641290-project-member] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 978.989496] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 978.992039] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.992219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.998634] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.468143] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.468368] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.468492] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.468801] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.469586] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.469771] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.469892] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.470182] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.470456] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.470528] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.470620] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.470722] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.470827] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.470933] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.471051] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.471187] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.494983] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.494983] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 979.495202] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.495923] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-243" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.495923] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-ff746fcc-55d5-424c-b830-e14844ac7a1a taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.496143] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-ff746fcc-55d5-424c-b830-e14844ac7a1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.496283] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-ff746fcc-55d5-424c-b830-e14844ac7a1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.496663] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-ff746fcc-55d5-424c-b830-e14844ac7a1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.496834] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff746fcc-55d5-424c-b830-e14844ac7a1a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.500449] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.793983] env[66364]: INFO networking_nsxv3.common.synchronization [None req-9bce0586-4ad7-4a8b-8415-ab1986c4e41c None None] Enqueued Resource ID: c54d6c3b-e2ee-4abd-9445-2141c8031cd9 with Priority: HIGHEST for action port [ 979.794474] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c54d6c3b-e2ee-4abd-9445-2141c8031cd9 with Priority: HIGHEST for action port [ 979.795197] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c54d6c3b-e2ee-4abd-9445-2141c8031cd9 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.795197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c54d6c3b-e2ee-4abd-9445-2141c8031cd9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.795197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c54d6c3b-e2ee-4abd-9445-2141c8031cd9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.795451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c54d6c3b-e2ee-4abd-9445-2141c8031cd9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.795451] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c54d6c3b-e2ee-4abd-9445-2141c8031cd9',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.999032] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.999344] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.999632] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.999837] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.999989] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.000165] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port ff746fcc-55d5-424c-b830-e14844ac7a1a not found, creating... [ 980.000429] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.000604] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.000728] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.001047] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.001339] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.001746] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.001979] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.002171] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.002403] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.002604] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.002757] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: ff746fcc-55d5-424c-b830-e14844ac7a1a is going to be created. [ 980.003960] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.004086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.004215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.004395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.004487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.004575] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 980.039742] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.039742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.039742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.039742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.039742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.040040] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-ff746fcc-55d5-424c-b830-e14844ac7a1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.052886] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.053069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.053123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.053330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.053476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.063168] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 980.296906] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c54d6c3b-e2ee-4abd-9445-2141c8031cd9 [ 980.297548] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.297548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.297548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.298250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.298363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.298481] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c54d6c3b-e2ee-4abd-9445-2141c8031cd9 already deleted. [ 980.298568] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c54d6c3b-e2ee-4abd-9445-2141c8031cd9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.753301] env[66364]: INFO networking_nsxv3.common.synchronization [req-dca7f742-840c-4dac-9502-fa834ecf2edb req-a5b08164-c280-441c-a5d7-36762038f1b1 service nova] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_rules [ 980.753516] env[66364]: INFO networking_nsxv3.common.synchronization [req-dca7f742-840c-4dac-9502-fa834ecf2edb req-a5b08164-c280-441c-a5d7-36762038f1b1 service nova] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 980.753701] env[66364]: INFO networking_nsxv3.common.synchronization [req-dca7f742-840c-4dac-9502-fa834ecf2edb req-a5b08164-c280-441c-a5d7-36762038f1b1 service nova] Enqueued Resource ID: ff746fcc-55d5-424c-b830-e14844ac7a1a with Priority: HIGHEST for action port [ 980.754351] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_rules [ 980.754513] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 980.754635] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff746fcc-55d5-424c-b830-e14844ac7a1a with Priority: HIGHEST for action port [ 980.754956] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.755095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.755335] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.755416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.755603] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff746fcc-55d5-424c-b830-e14844ac7a1a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.755754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff746fcc-55d5-424c-b830-e14844ac7a1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.755754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff746fcc-55d5-424c-b830-e14844ac7a1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.755995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff746fcc-55d5-424c-b830-e14844ac7a1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.756052] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff746fcc-55d5-424c-b830-e14844ac7a1a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.885653] env[66364]: INFO networking_nsxv3.common.synchronization [req-3e7d76a6-9647-43df-be3d-f6d9acc08bbd req-a76fa4a9-a9bf-4ad4-b05b-8905af38f8cc tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_members [ 980.886064] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 with Priority: HIGHEST for action security_group_members [ 980.886410] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-caf65fab-7b8a-4ed0-8b20-496896e11d68 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.886565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.886658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.887396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.887396] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.887396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.887396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.887604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.887604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.887703] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('caf65fab-7b8a-4ed0-8b20-496896e11d68',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.261019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff746fcc-55d5-424c-b830-e14844ac7a1a with status ACTIVE [ 981.261280] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.261423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.261486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.262037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.262037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.262037] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.262240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.262240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.262411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.262465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.262630] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.262716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.262773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.262910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.262977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.263205] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff746fcc-55d5-424c-b830-e14844ac7a1a is going to be updated. [ 981.270776] env[66364]: INFO networking_nsxv3.common.synchronization [req-74c7917c-5deb-4854-afbf-77c4a7de8b32 req-4d506368-56c7-4e4b-99ec-28c4e13c6de2 tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 981.270776] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 981.270776] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.270776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.270776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.272061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.272271] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.272404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.272584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.273471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.273471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.273471] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.288802] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.289371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.289487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.289728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.289956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.290182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff746fcc-55d5-424c-b830-e14844ac7a1a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.391051] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.391051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.391051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.391322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.391322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.392175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.392405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.392513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.392913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.393060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.393211] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 is going to be updated. [ 981.421462] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.421607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.421689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.421913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.422072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.431846] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 in Status: IN_PROGRESS for 2s [ 981.654876] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.655110] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.655305] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.655535] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.655794] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.655950] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.657691] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.657979] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.658154] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.659511] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.659604] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 981.659709] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 981.659843] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 981.659975] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 981.660120] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 981.661044] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 981.684272] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 981.684448] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 981.684743] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 981.684743] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.686313] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-b9e578ca-0967-4ec1-813d-897749df67ca taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.686313] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-b9e578ca-0967-4ec1-813d-897749df67ca" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.686313] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-b9e578ca-0967-4ec1-813d-897749df67ca" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.686313] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-b9e578ca-0967-4ec1-813d-897749df67ca" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.686313] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9e578ca-0967-4ec1-813d-897749df67ca',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.702866] env[66364]: INFO networking_nsxv3.common.synchronization [None req-0835c3af-f75e-4842-8cb1-a2dc90646f8b None None] Enqueued Resource ID: 7ab6806c-c230-4467-abbe-ab7a36b54bff with Priority: HIGHEST for action port [ 981.705876] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ab6806c-c230-4467-abbe-ab7a36b54bff with Priority: HIGHEST for action port [ 981.705876] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ab6806c-c230-4467-abbe-ab7a36b54bff taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.705876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ab6806c-c230-4467-abbe-ab7a36b54bff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.705876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ab6806c-c230-4467-abbe-ab7a36b54bff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.705876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ab6806c-c230-4467-abbe-ab7a36b54bff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.705876] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ab6806c-c230-4467-abbe-ab7a36b54bff',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.778242] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.778242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.778242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.778242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.778242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.778784] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.778903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.778971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.779169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.779251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.779346] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 981.806674] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.806826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.806894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.807115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.807293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.816636] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 982.057052] env[66364]: INFO networking_nsxv3.common.synchronization [None req-9bd31d70-4d91-409e-a9c7-bfb83e0fc550 tempest-AttachVolumeShelveTestJSON-446961995 tempest-AttachVolumeShelveTestJSON-446961995-project-member] Enqueued Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_rules [ 982.057602] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_rules [ 982.057911] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.058035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.058103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.058342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.058420] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.077110] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 982.077110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.077405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.077594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.077776] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.077881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.078610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.078610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.078610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.078610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.078610] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.079229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.079474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.079706] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.080033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.080135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.080360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.081899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.082078] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.189460] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.189693] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.189815] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.190197] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.190376] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.190535] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port b9e578ca-0967-4ec1-813d-897749df67ca not found, creating... [ 982.190790] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.191434] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.191981] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.192355] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.192522] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.193135] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.193363] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.197017] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.197017] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.197017] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.197017] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: b9e578ca-0967-4ec1-813d-897749df67ca is going to be created. [ 982.206608] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ab6806c-c230-4467-abbe-ab7a36b54bff [ 982.206933] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.207082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.207147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.208499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.208621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.208742] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ab6806c-c230-4467-abbe-ab7a36b54bff already deleted. [ 982.208818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ab6806c-c230-4467-abbe-ab7a36b54bff" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.216564] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.216801] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.216919] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.217204] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.217440] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.217654] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-b9e578ca-0967-4ec1-813d-897749df67ca" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.236019] env[66364]: INFO networking_nsxv3.common.synchronization [None req-68d2551c-cda3-47e8-9879-2d5c74780161 tempest-AttachVolumeShelveTestJSON-446961995 tempest-AttachVolumeShelveTestJSON-446961995-project-member] Enqueued Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_rules [ 982.237351] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_rules [ 982.237351] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.237351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.584433] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.584652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.584820] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.586791] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.586984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.586984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.587200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.587282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.587373] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d105259-6c05-4d26-aa23-5631556fbf46 already deleted. [ 982.587476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.587629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.587814] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.587892] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.957737] env[66364]: INFO networking_nsxv3.common.synchronization [req-74c7917c-5deb-4854-afbf-77c4a7de8b32 req-2e30417b-243f-4570-8cbe-996f6e8a6aac service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 982.957737] env[66364]: INFO networking_nsxv3.common.synchronization [req-74c7917c-5deb-4854-afbf-77c4a7de8b32 req-2e30417b-243f-4570-8cbe-996f6e8a6aac service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 982.957737] env[66364]: INFO networking_nsxv3.common.synchronization [req-74c7917c-5deb-4854-afbf-77c4a7de8b32 req-2e30417b-243f-4570-8cbe-996f6e8a6aac service nova] Enqueued Resource ID: b9e578ca-0967-4ec1-813d-897749df67ca with Priority: HIGHEST for action port [ 982.957985] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 982.957985] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 982.958073] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9e578ca-0967-4ec1-813d-897749df67ca with Priority: HIGHEST for action port [ 982.958644] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.958761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.959070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.959070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.959213] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.959914] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.960025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.960213] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9e578ca-0967-4ec1-813d-897749df67ca taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.960314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9e578ca-0967-4ec1-813d-897749df67ca" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.960395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9e578ca-0967-4ec1-813d-897749df67ca" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.960619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9e578ca-0967-4ec1-813d-897749df67ca" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.960738] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9e578ca-0967-4ec1-813d-897749df67ca',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.090323] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.110800] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.110800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.110800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.110800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.110800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.110800] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d105259-6c05-4d26-aa23-5631556fbf46 already deleted. [ 983.110800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.445798] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 in Status: SUCCESS [ 983.446177] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: caf65fab-7b8a-4ed0-8b20-496896e11d68 deletion is rescheduled due to dependency. [ 983.446389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-caf65fab-7b8a-4ed0-8b20-496896e11d68" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.462258] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.462460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.463068] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9e578ca-0967-4ec1-813d-897749df67ca with status ACTIVE [ 983.463068] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.463068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.463264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.463969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.463969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.463969] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.463969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.463969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.464276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.464328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.464558] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.464684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.464771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.464957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.465072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.465181] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9e578ca-0967-4ec1-813d-897749df67ca is going to be updated. [ 983.496513] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.496513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.496513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.496513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.496513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.496513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9e578ca-0967-4ec1-813d-897749df67ca" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.594078] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.594259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.594259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.594503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.594580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.594686] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 983.646674] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.647024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.647174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.647585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.647765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.659539] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 983.829729] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 983.831030] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 983.831030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.831030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.831030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.831533] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.833018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.833018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.833018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.833018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.833018] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.976465] env[66364]: INFO networking_nsxv3.common.synchronization [req-4337af4e-9c21-4699-8c49-16b0fa3b185f req-c7823445-7e98-404f-9bbc-33bd205d4f1a tempest-ServerDiagnosticsNegativeTest-1432855102 tempest-ServerDiagnosticsNegativeTest-1432855102-project-member] Enqueued Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGHEST for action security_group_members [ 983.977422] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGHEST for action security_group_members [ 983.977839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a00587d-7e00-43fa-be8e-c9edb939cd26 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.978020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.978122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.978509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.978709] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.978888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.978953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.979206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.979328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.979466] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a00587d-7e00-43fa-be8e-c9edb939cd26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.335926] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.390335] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.390525] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.390645] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.390915] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.391184] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.391338] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.391452] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.391668] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.391813] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.392150] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.392283] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.392459] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.395032] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.395339] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.395586] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.395840] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.421021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.421243] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 984.421396] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.421646] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.422194] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.422408] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.422520] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.422842] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.422977] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6448a6d4-0f4a-4cf7-8a45-383f2038f7d3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.481801] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.482238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.482357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.482686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.482852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.483338] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.483338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.483338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.483552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.483604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.483712] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 already deleted. [ 984.483765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.841176] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.926123] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.926395] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.926541] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.926867] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.927113] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.927222] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 6448a6d4-0f4a-4cf7-8a45-383f2038f7d3 not found, creating... [ 984.927506] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.927699] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.927843] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.928213] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.928475] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.928947] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.929885] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.930158] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.930530] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.930773] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.931122] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 6448a6d4-0f4a-4cf7-8a45-383f2038f7d3 is going to be created. [ 984.957428] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.957428] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.957428] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.957609] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.957718] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.959292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.347965] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.348297] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.348392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.348588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.348680] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.348779] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 985.379075] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.379285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.379285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.379461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.379602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.388846] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 985.534828] env[66364]: INFO networking_nsxv3.common.synchronization [req-8597955d-b012-4afa-95b7-ababcc225dd6 req-fb828a13-cab6-49c0-9694-71cb794847e2 tempest-AttachInterfacesV270Test-1631680532 tempest-AttachInterfacesV270Test-1631680532-project-member] Enqueued Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGHEST for action security_group_members [ 985.536113] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGHEST for action security_group_members [ 985.536571] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.536701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.536758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.536999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.537951] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.538082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.538153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.538333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.538632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.538632] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c98b6c22-a778-4b7a-8143-b67c9c0e3eef',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.671379] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 985.671755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.672246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.672330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.672531] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.672706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.672799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.672987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.673085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.673179] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.736743] env[66364]: INFO networking_nsxv3.common.synchronization [req-4337af4e-9c21-4699-8c49-16b0fa3b185f req-b88d9c6b-a8eb-448f-bd8d-ccef55fa830a service nova] Enqueued Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGHEST for action security_group_rules [ 985.736743] env[66364]: INFO networking_nsxv3.common.synchronization [req-4337af4e-9c21-4699-8c49-16b0fa3b185f req-b88d9c6b-a8eb-448f-bd8d-ccef55fa830a service nova] Enqueued Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGHEST for action security_group_members [ 985.736743] env[66364]: INFO networking_nsxv3.common.synchronization [req-4337af4e-9c21-4699-8c49-16b0fa3b185f req-b88d9c6b-a8eb-448f-bd8d-ccef55fa830a service nova] Enqueued Resource ID: 6448a6d4-0f4a-4cf7-8a45-383f2038f7d3 with Priority: HIGHEST for action port [ 985.737366] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGHEST for action security_group_rules [ 985.737506] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGHEST for action security_group_members [ 985.737633] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6448a6d4-0f4a-4cf7-8a45-383f2038f7d3 with Priority: HIGHEST for action port [ 985.737879] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a00587d-7e00-43fa-be8e-c9edb939cd26 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.738022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.738092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.738775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.738868] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a00587d-7e00-43fa-be8e-c9edb939cd26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.739740] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a00587d-7e00-43fa-be8e-c9edb939cd26 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.740332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.740332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.740332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.740332] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.740332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.741475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.741475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.742613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.742815] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a00587d-7e00-43fa-be8e-c9edb939cd26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.743668] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.744327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.744327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.744327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.744465] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6448a6d4-0f4a-4cf7-8a45-383f2038f7d3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.041845] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.042075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.042333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.042592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.042703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.042931] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.043061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.043133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.043299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.043374] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.043472] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef is going to be updated. [ 986.096884] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.096884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.096884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.096884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.096884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.104909] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef in Status: IN_PROGRESS for 2s [ 986.175516] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.246185] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a00587d-7e00-43fa-be8e-c9edb939cd26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.248378] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a00587d-7e00-43fa-be8e-c9edb939cd26 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.248565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.248808] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6448a6d4-0f4a-4cf7-8a45-383f2038f7d3 with status ACTIVE [ 986.249061] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.249554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.249554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.249633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.249773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.252890] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.253026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.253179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.253412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.254082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.254217] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.254337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.254403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.255031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.255128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.255223] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6448a6d4-0f4a-4cf7-8a45-383f2038f7d3 is going to be updated. [ 986.279646] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.279791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.279828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.280076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.280268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.280478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6448a6d4-0f4a-4cf7-8a45-383f2038f7d3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.536378] env[66364]: INFO networking_nsxv3.common.synchronization [None req-09935c5d-44b8-4ca6-a1c4-c5a7da67574f tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_rules [ 986.536985] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_rules [ 986.539843] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.539843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.539843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.539843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.539843] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.677660] env[66364]: INFO networking_nsxv3.common.synchronization [None req-ead814b8-006e-4272-b2f5-75072dfdcabb tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_rules [ 986.679424] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.681797] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_rules [ 986.681797] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.681797] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.748869] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a00587d-7e00-43fa-be8e-c9edb939cd26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.064509] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.064764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.064934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.065326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.065455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.065544] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40420088-ac97-4318-add0-c3b84e42921a already deleted. [ 987.065648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.065823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.066164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.066314] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.183597] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.183597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.183736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.184064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.184242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.184400] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 987.187294] env[66364]: INFO networking_nsxv3.common.synchronization [None req-750e7252-12f1-48c5-a9d2-7c13202a5c95 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_rules [ 987.188081] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_rules [ 987.189204] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.189385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.189488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.189830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.189958] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.220248] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.220366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.220366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.220740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.220901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.232961] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 987.252952] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.253261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.253316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.253540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.253634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.253736] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 is going to be created. [ 987.283734] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.283841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.283841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.284125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.284390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.298069] env[66364]: INFO networking_nsxv3.common.synchronization [None req-23a96e0d-1080-4b72-abc8-14ba7bea3bea tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_rules [ 987.299674] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_rules [ 987.299674] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.299674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.308376] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 in Status: UNINITIALIZED for 2s [ 987.405910] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 987.406033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.406228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.406422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.406620] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.407619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.407619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.407619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.407619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.407619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.407619] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.598014] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.598314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.598314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.598541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.598637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.598899] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40420088-ac97-4318-add0-c3b84e42921a already deleted. [ 987.598989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.715269] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.715467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.715537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.715730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.715816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.715910] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc470104-8593-4197-8a42-8965abae6489 already deleted. [ 987.715993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.716447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.716748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.716835] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.912870] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.913169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.913169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.913436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.913641] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.913767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.913847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.914010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.914122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.914242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.914404] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.914493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.914551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.914688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.914837] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.914953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.914988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.915193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.915301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.915494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.915494] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.117609] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef in Status: SUCCESS [ 988.117609] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef deletion is rescheduled due to dependency. [ 988.117609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.251954] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.253281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.253281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.253281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.253281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.253281] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc470104-8593-4197-8a42-8965abae6489 already deleted. [ 988.253281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.419648] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e327b378-51f2-4bc5-8b1c-697b0302c4a5: rpc.has_security_group_logging(os_id): False [ 988.446289] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.446505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.446587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.446861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.446969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.447245] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.447362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.447446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.447684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.447837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.447969] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.448099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.448099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.448271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.448344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.448500] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.448617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.448705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.448802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.448877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.448950] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 988.639518] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.639887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.639887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.639957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.640127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.659312] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 989.246515] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 989.246875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.247107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.247401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.247602] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.247719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.247785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.247986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.248104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.248384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.248636] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.248775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.248857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.249044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.249229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.249363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.249445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.249615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.249712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.249812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.249919] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.323018] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 in Status: SUCCESS [ 989.323245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.323442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.323690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.323891] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.324052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.324131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.324324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.324406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.324502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.324735] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a00587d-7e00-43fa-be8e-c9edb939cd26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.753438] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8: rpc.has_security_group_logging(os_id): False [ 989.773331] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.773527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.773527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.773749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.774096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.774096] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.774232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.774287] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.774472] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.774577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.774765] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.774860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.774919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.775081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.775155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.775368] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.775463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.775513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.775659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.775732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.775814] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 989.831034] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a00587d-7e00-43fa-be8e-c9edb939cd26 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.831034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.831034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.831242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.831351] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.831444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.831501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.831658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.831742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.831829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.835395] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a00587d-7e00-43fa-be8e-c9edb939cd26 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.835395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.835395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.835395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.835395] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.835395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.835395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.835395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.835395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.835395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.835395] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a00587d-7e00-43fa-be8e-c9edb939cd26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.839300] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.839300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.839300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.839300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.839300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.860253] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 990.337064] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a00587d-7e00-43fa-be8e-c9edb939cd26: rpc.has_security_group_logging(os_id): False [ 990.369233] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.369233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.369233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.369233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.369233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.369233] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.369233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.369233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.369233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.369233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.369233] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.370676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.370810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.371063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.371159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.371530] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.371669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.371725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.371867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.371944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.372041] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 is going to be created. [ 990.466155] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.466718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.466718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.466929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.466978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.494670] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 in Status: IN_PROGRESS for 2s [ 990.677292] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 990.677714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.837339] env[66364]: INFO networking_nsxv3.common.synchronization [req-b91cc251-1266-4504-92c4-19bc58def35d req-f4ae462b-f27a-41d3-9b7c-b8cbe680aded tempest-ServerRescueTestJSON-343135033 tempest-ServerRescueTestJSON-343135033-project-member] Enqueued Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 990.838921] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGHEST for action security_group_members [ 990.838921] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.838921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.838921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.839236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.839383] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.839538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.839611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.839861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.839981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.840100] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.342638] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.342811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.342882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.343265] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.343427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.343810] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.343810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.343810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.344419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.344419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.344419] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c is going to be updated. [ 991.381523] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.381523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.381523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.381523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.381777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.393859] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: IN_PROGRESS for 2s [ 991.800586] env[66364]: INFO networking_nsxv3.common.synchronization [req-4cab4386-1788-4d48-8d83-84a03b43cbbb req-33a01fcd-8b8d-4d7b-9f99-7b1dec9f7b51 tempest-MultipleCreateTestJSON-1757641290 tempest-MultipleCreateTestJSON-1757641290-project-member] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 991.801503] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 991.801855] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.801855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.801855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.802302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.802302] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.802442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.802442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.802607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.802649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.802719] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.881666] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 991.882012] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.882503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.882607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.882730] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.947156] env[66364]: INFO networking_nsxv3.common.synchronization [req-c16eb2f2-7ed8-4ec7-a4ec-61eaf51df55a req-262a397d-5b5f-4fdf-aa2a-ba2e79ea47cb tempest-MultipleCreateTestJSON-1757641290 tempest-MultipleCreateTestJSON-1757641290-project-member] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 991.947733] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGHEST for action security_group_members [ 991.949034] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.949034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.304522] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.385011] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.385223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.521424] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 in Status: SUCCESS [ 992.521424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.808321] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.287068] env[66364]: INFO networking_nsxv3.common.synchronization [req-fbd63dc6-be18-4adb-80ad-2d8c0a08c5fa req-a7bf1b9e-66fd-4951-9d62-123bba59b869 tempest-ServerGroupTestJSON-1947604458 tempest-ServerGroupTestJSON-1947604458-project-member] Enqueued Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGHEST for action security_group_members [ 993.287560] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGHEST for action security_group_members [ 993.287864] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c406b1-8de5-46fa-bdd6-2eccaf845753 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.288154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.288224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.289397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.289579] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.289693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.289759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.289941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.290044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.290137] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4c406b1-8de5-46fa-bdd6-2eccaf845753',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.310284] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.310513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.310513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.310733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.310819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.310965] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 993.346669] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.346895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.346895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.347138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.347287] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.361208] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 993.407721] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 779e6414-54c4-4ab2-8678-8a31896ce93c in Status: SUCCESS [ 993.407889] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c deletion is rescheduled due to dependency. [ 993.408014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.674815] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-447 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.675018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-447" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.675149] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-447" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.675526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-447" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.675859] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.676043] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.676165] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.676390] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.676795] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.676795] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.676933] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.676973] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.677080] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.677189] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.677295] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.677435] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.701909] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.702086] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 993.702258] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.702470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-447" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.702781] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.702944] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.703072] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.703453] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.703595] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0dbd2a3-f98c-4c64-96fd-7fbaec57c496',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.793031] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.793031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.793031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.793321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.793321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.793403] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.793509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.793589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.793753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.793839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.793935] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 already deleted. [ 993.794063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.207059] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.207059] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.207315] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.207476] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.207649] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.207813] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port b0dbd2a3-f98c-4c64-96fd-7fbaec57c496 not found, creating... [ 994.208146] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.208335] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.208467] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.208725] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.208890] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.209195] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.209355] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.209474] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.209687] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.209821] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.209960] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: b0dbd2a3-f98c-4c64-96fd-7fbaec57c496 is going to be created. [ 994.233371] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.233876] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.233876] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.236476] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.236476] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.236476] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.237129] env[66364]: INFO networking_nsxv3.common.synchronization [None req-7a309b3a-8f7f-4a36-8844-f5aa769bf151 None None] Enqueued Resource ID: f63fc8b8-2b02-49af-9aa7-c43dd8977d94 with Priority: HIGHEST for action port [ 994.237546] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f63fc8b8-2b02-49af-9aa7-c43dd8977d94 with Priority: HIGHEST for action port [ 994.238095] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-f63fc8b8-2b02-49af-9aa7-c43dd8977d94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.238206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f63fc8b8-2b02-49af-9aa7-c43dd8977d94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.238307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f63fc8b8-2b02-49af-9aa7-c43dd8977d94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.238540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f63fc8b8-2b02-49af-9aa7-c43dd8977d94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.238618] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f63fc8b8-2b02-49af-9aa7-c43dd8977d94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.740684] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f63fc8b8-2b02-49af-9aa7-c43dd8977d94 [ 994.741570] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.742341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.742427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.742652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.742745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.742844] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f63fc8b8-2b02-49af-9aa7-c43dd8977d94 already deleted. [ 994.742924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f63fc8b8-2b02-49af-9aa7-c43dd8977d94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.952087] env[66364]: INFO networking_nsxv3.common.synchronization [req-fbd63dc6-be18-4adb-80ad-2d8c0a08c5fa req-a64cb19f-7f98-42a1-9881-60bb2de902c0 service nova] Enqueued Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGHEST for action security_group_rules [ 994.952344] env[66364]: INFO networking_nsxv3.common.synchronization [req-fbd63dc6-be18-4adb-80ad-2d8c0a08c5fa req-a64cb19f-7f98-42a1-9881-60bb2de902c0 service nova] Enqueued Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGHEST for action security_group_members [ 994.952492] env[66364]: INFO networking_nsxv3.common.synchronization [req-fbd63dc6-be18-4adb-80ad-2d8c0a08c5fa req-a64cb19f-7f98-42a1-9881-60bb2de902c0 service nova] Enqueued Resource ID: b0dbd2a3-f98c-4c64-96fd-7fbaec57c496 with Priority: HIGHEST for action port [ 994.952720] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGHEST for action security_group_rules [ 994.952846] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGHEST for action security_group_members [ 994.952960] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0dbd2a3-f98c-4c64-96fd-7fbaec57c496 with Priority: HIGHEST for action port [ 994.953504] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.953635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.953701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.953953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.954036] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4c406b1-8de5-46fa-bdd6-2eccaf845753',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.954984] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c406b1-8de5-46fa-bdd6-2eccaf845753 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.955108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.955176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.955483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.955661] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.955768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.955910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.956022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.956100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.956216] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4c406b1-8de5-46fa-bdd6-2eccaf845753',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.956933] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.958171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.958267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.959548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.959548] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0dbd2a3-f98c-4c64-96fd-7fbaec57c496',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.375360] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 995.375360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.375644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.375826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.376076] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.376271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.376383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.376617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.376783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.376859] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.463032] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4c406b1-8de5-46fa-bdd6-2eccaf845753',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.463032] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c406b1-8de5-46fa-bdd6-2eccaf845753 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.463032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.463032] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0dbd2a3-f98c-4c64-96fd-7fbaec57c496 with status ACTIVE [ 995.463032] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.463032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.463032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.463032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.463032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.463032] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.463032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.463032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.463032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.463032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.463935] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.463935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.463935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.464252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.464393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.464512] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0dbd2a3-f98c-4c64-96fd-7fbaec57c496 is going to be updated. [ 995.491945] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.492183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.492268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.492818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.492818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.493214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0dbd2a3-f98c-4c64-96fd-7fbaec57c496" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.879219] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.879605] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.879605] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.879791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.879791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.880217] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.880217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.880217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.880389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.880389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.880465] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 995.910282] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.910282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.910282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.910546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.910646] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.921799] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 995.968778] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4c406b1-8de5-46fa-bdd6-2eccaf845753',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.473126] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.475733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.475733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.475733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.475733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.475733] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 is going to be created. [ 996.516799] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.516970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.517179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.518278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.518278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.534548] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 in Status: UNINITIALIZED for 2s [ 996.706465] env[66364]: INFO networking_nsxv3.common.synchronization [None req-07449196-6b18-4863-9a8e-145744a48b7c None None] Enqueued Resource ID: ea352be4-0752-47da-a947-6186289c7f1d with Priority: HIGHEST for action port [ 996.707178] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea352be4-0752-47da-a947-6186289c7f1d with Priority: HIGHEST for action port [ 996.707520] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea352be4-0752-47da-a947-6186289c7f1d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.707776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea352be4-0752-47da-a947-6186289c7f1d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.707776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea352be4-0752-47da-a947-6186289c7f1d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.708115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea352be4-0752-47da-a947-6186289c7f1d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.708206] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea352be4-0752-47da-a947-6186289c7f1d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.771766] env[66364]: INFO networking_nsxv3.common.synchronization [None req-8a7f28cd-9334-4664-beda-ab085365f0bc tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_rules [ 996.771895] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_rules [ 996.772368] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.772626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.772762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.774247] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.774247] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.909913] env[66364]: INFO networking_nsxv3.common.synchronization [None req-d04d8e69-617c-46a2-8270-b1cd49d9b5ba tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_rules [ 996.909913] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_rules [ 996.909913] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.909913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.211989] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea352be4-0752-47da-a947-6186289c7f1d [ 997.211989] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.211989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.211989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.211989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.211989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.211989] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea352be4-0752-47da-a947-6186289c7f1d already deleted. [ 997.211989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea352be4-0752-47da-a947-6186289c7f1d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.310532] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.310532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.310532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.310532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.310532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.310532] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f already deleted. [ 997.310532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.311362] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.311722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.311994] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.834193] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.834193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.834193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.834193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.834193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.834193] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f already deleted. [ 997.834193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.937255] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 997.937255] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 deletion is rescheduled due to dependency. [ 997.937255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.937255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.937255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.937255] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.937255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.937255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.937255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.937255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.937255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.937255] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.943950] env[66364]: INFO networking_nsxv3.common.synchronization [req-67a6d141-94bc-49f2-bba7-cbd9190225b1 req-0460312b-b69a-4df7-915b-8a16f12fc6ce tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 997.945842] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 997.946751] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.947129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.947508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.947989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.948441] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.948754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.951019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.951019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.951019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.951019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.020537] env[66364]: INFO networking_nsxv3.common.synchronization [req-bd876e95-0ded-4ce6-8564-9a053972b56f req-a65f97eb-7a49-469b-953c-d54667b69c2c tempest-ServerDiagnosticsNegativeTest-1432855102 tempest-ServerDiagnosticsNegativeTest-1432855102-project-member] Enqueued Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGHEST for action security_group_members [ 998.020537] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGHEST for action security_group_members [ 998.023850] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a00587d-7e00-43fa-be8e-c9edb939cd26 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.023850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.023850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.023850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.023850] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.023850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.023850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.023850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.023850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.023850] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a00587d-7e00-43fa-be8e-c9edb939cd26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.333721] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.333970] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.334056] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.335490] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.335490] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.335490] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.335490] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.335490] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.335490] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.336147] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.336147] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.336147] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.336147] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.336147] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.336147] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.336704] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.358581] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.359054] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 998.361040] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.361040] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.361040] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.361040] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.361040] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.361040] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.361040] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.442882] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.443115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.443204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.443427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.443599] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.443695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.443755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.443901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.443989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.445705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.445705] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.445705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.445705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.445705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.445705] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.445705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.445705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.445705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.445705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.445705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.445705] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.454843] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.454843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.454843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.454843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.454843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.454843] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.454843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.454843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.454843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.454843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.454843] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d already deleted. [ 998.454843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.527907] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.528107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.528185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.528411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.528530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.528809] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.528911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.528973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.529195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.529279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.529397] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 is going to be updated. [ 998.545811] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 in Status: SUCCESS [ 998.546114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.546412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.546711] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.546901] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.547052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.547120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.547300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.547387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.547478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.547572] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4c406b1-8de5-46fa-bdd6-2eccaf845753',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.564756] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.564952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.565035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.565226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.565385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.577591] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 in Status: IN_PROGRESS for 2s [ 998.864146] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.864491] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.864629] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.864915] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.865143] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.865325] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b not found, creating... [ 998.865696] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.865903] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.866064] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.866327] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.866469] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.866787] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.866968] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.867121] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.867396] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.867556] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.867731] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b is going to be created. [ 998.891969] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.892656] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.892898] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.893508] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.893657] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.894037] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.947911] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8: rpc.has_security_group_logging(os_id): False [ 998.971399] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.971399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.971399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.971726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.971784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.972104] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.972248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.972343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.972615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.972772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.973098] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.973260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.973374] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.973612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.973733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.974015] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.974189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.974358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.974598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.974825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.974825] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be updated. [ 999.049932] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c406b1-8de5-46fa-bdd6-2eccaf845753 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.050315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.050393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.050615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.050812] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.050932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.050998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.051253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.051337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.051430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.051593] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c406b1-8de5-46fa-bdd6-2eccaf845753 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.051710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.051776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.051929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.052091] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.052207] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.052273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.052454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.052570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.052622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.052712] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4c406b1-8de5-46fa-bdd6-2eccaf845753',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.105485] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.105682] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.105754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.106053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.106280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.126984] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: IN_PROGRESS for 2s [ 999.554789] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4c406b1-8de5-46fa-bdd6-2eccaf845753: rpc.has_security_group_logging(os_id): False [ 999.576561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.576561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.577072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.577072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.577072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.577301] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.577301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.577301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.577409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.577474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.577645] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.577738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.577793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.577937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.578020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.578193] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.578285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.578341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.578482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.578554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.578637] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 is going to be created. [ 999.649787] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.649787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.649787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.649787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.649787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.653649] env[66364]: INFO networking_nsxv3.common.synchronization [req-67a6d141-94bc-49f2-bba7-cbd9190225b1 req-6e83c4ce-ff63-40fa-934f-27a927e66859 service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 999.654663] env[66364]: INFO networking_nsxv3.common.synchronization [req-67a6d141-94bc-49f2-bba7-cbd9190225b1 req-6e83c4ce-ff63-40fa-934f-27a927e66859 service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 999.654663] env[66364]: INFO networking_nsxv3.common.synchronization [req-67a6d141-94bc-49f2-bba7-cbd9190225b1 req-6e83c4ce-ff63-40fa-934f-27a927e66859 service nova] Enqueued Resource ID: d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b with Priority: HIGHEST for action port [ 999.656534] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 999.656534] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 999.656534] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b with Priority: HIGHEST for action port [ 999.656934] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.657103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.657248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.659055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.659055] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.659055] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.659055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.659055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.659055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.659276] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.659276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.659361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.659462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.659540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.659626] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.660878] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.661020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.661119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.661261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.661350] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.663608] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 in Status: IN_PROGRESS for 2s [ 1000.163204] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.163550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.163550] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.164605] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b with status ACTIVE [ 1000.164799] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.164921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.169099] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.169099] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.169099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.169667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.169667] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b is going to be updated. [ 1000.196617] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.196809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.196809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.197730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.197730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.197730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5e969a6-3b2a-4eb1-b43a-5ba69f256b7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.227776] env[66364]: INFO networking_nsxv3.common.synchronization [req-45b24e37-5b72-4d94-b2ac-5898e248b68a req-0732e907-949d-4739-aeca-a2df7f1402cd tempest-AttachVolumeShelveTestJSON-446961995 tempest-AttachVolumeShelveTestJSON-446961995-project-member] Enqueued Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_members [ 1000.230761] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_members [ 1000.230761] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.230761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.230761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.230761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.231686] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.231916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.233019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.233019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.233019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.233019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.589139] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 in Status: SUCCESS [ 1000.589321] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 deletion is rescheduled due to dependency. [ 1000.589437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.643775] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.644034] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.644157] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.644610] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.644793] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.644919] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.645047] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.645293] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.645522] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.645784] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.645899] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.646020] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.646128] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.646240] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1000.646331] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.646511] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.667414] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.667620] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1000.667771] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.667956] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.668482] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-9630e5f1-77be-4e60-9df4-392603020f17 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.668580] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.669222] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.669222] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.669222] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9630e5f1-77be-4e60-9df4-392603020f17',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.670881] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.736279] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.736279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.736279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.736513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.736513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.737054] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.737054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.737054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.737054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.737054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.737434] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d105259-6c05-4d26-aa23-5631556fbf46 already deleted. [ 1000.737434] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.143930] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 in Status: SUCCESS [ 1001.144101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.171600] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.172070] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.172070] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.172358] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.172553] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.172722] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 9630e5f1-77be-4e60-9df4-392603020f17 not found, creating... [ 1001.173052] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.173250] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.173386] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.173670] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.173826] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.174175] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.174422] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.174583] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.174832] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.175013] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.175196] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 9630e5f1-77be-4e60-9df4-392603020f17 is going to be created. [ 1001.176603] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.176745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.176815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.177026] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.177106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.177212] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be created. [ 1001.199605] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.199892] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.200055] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.200335] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.200913] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.200913] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.204738] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.204738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.204987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.204987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.205148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.216443] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: UNINITIALIZED for 2s [ 1001.676756] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 in Status: SUCCESS [ 1001.677091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.927396] env[66364]: INFO networking_nsxv3.common.synchronization [req-45b24e37-5b72-4d94-b2ac-5898e248b68a req-b7dd068d-7041-45ed-8594-862c8eb76cc6 service nova] Enqueued Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_rules [ 1001.927674] env[66364]: INFO networking_nsxv3.common.synchronization [req-45b24e37-5b72-4d94-b2ac-5898e248b68a req-b7dd068d-7041-45ed-8594-862c8eb76cc6 service nova] Enqueued Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_members [ 1001.927886] env[66364]: INFO networking_nsxv3.common.synchronization [req-45b24e37-5b72-4d94-b2ac-5898e248b68a req-b7dd068d-7041-45ed-8594-862c8eb76cc6 service nova] Enqueued Resource ID: 9630e5f1-77be-4e60-9df4-392603020f17 with Priority: HIGHEST for action port [ 1001.928697] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_rules [ 1001.928939] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_members [ 1001.929031] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9630e5f1-77be-4e60-9df4-392603020f17 with Priority: HIGHEST for action port [ 1001.929364] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.929535] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.929633] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.929903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.930036] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.931084] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.931238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.931753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.932997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.932997] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.932997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.932997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.932997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.933329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.933479] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.935789] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9630e5f1-77be-4e60-9df4-392603020f17 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.935919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.936022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.936197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.936295] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9630e5f1-77be-4e60-9df4-392603020f17',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.436458] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.438769] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.438904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.441721] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9630e5f1-77be-4e60-9df4-392603020f17 with status ACTIVE [ 1002.442035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.442203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.442313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.442514] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.442671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.442880] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.443017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.443091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.443310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.443410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.443692] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.443796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.443867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.444030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.444109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.444226] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9630e5f1-77be-4e60-9df4-392603020f17 is going to be updated. [ 1002.468233] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.468419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.468501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.468710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.468854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.469019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.941380] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.229910] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: UNINITIALIZED for 4s [ 1003.444047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.444498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.444498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.445294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.445399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.445560] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d105259-6c05-4d26-aa23-5631556fbf46 is going to be created. [ 1003.473035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.473035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.473035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.473035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.473035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.488944] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: UNINITIALIZED for 2s [ 1005.243061] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1005.243458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.243458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.243895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.244061] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.244200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.244281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.244624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.244719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.244825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.244899] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.501807] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: SUCCESS [ 1005.502124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.502341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.502597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.502845] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.502973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.503070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.503269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.503366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.503519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.503588] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.747538] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.747726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.747811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.748132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.748371] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.748575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.748575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.748772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.748874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.748963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.749150] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.749258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.749332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.749464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.749627] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.749712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.749776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.749957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.750057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.750549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.750549] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.861934] env[66364]: INFO networking_nsxv3.common.synchronization [req-c0fe13ac-b2c2-41b6-aba8-6d26ca0904fa req-98b5098f-d4aa-4428-8f15-5ec1b894023a tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_members [ 1005.862712] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_members [ 1005.863214] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.863395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.863470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.863751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.863933] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.864090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.864156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.864376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.864474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.864575] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.007808] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.227904] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.228134] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.228258] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.228586] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.228900] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.229134] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.229262] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.229612] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.229777] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.230021] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.230158] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.230273] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.230383] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.230497] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.230684] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.230745] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.253345] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.253345] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.253345] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.253345] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.253345] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.253345] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.253345] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.253345] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.253345] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0359bd8a-c849-4f67-a5a7-d3f0bfa7356b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.254469] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b49ee1f8-75f0-4dc8-86a3-69683601a19d: rpc.has_security_group_logging(os_id): False [ 1006.273736] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.273824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.273869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.274052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.274144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.274473] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.274636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.274636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.274735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.274811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.274987] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.275094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.275151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.275299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.275420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.275600] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.275699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.275742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.276038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.276146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.276233] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be created. [ 1006.339622] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.339803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.339853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.340268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.340268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.351869] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1006.368220] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.368220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.368220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.368220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.368220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.368220] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.368220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.368553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.368553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.368553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.368660] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40420088-ac97-4318-add0-c3b84e42921a already deleted. [ 1006.368720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.513931] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d105259-6c05-4d26-aa23-5631556fbf46: rpc.has_security_group_logging(os_id): False [ 1006.537864] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.538260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.538411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.538720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.538929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.539187] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.539394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.539502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.539768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.539918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.540088] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d105259-6c05-4d26-aa23-5631556fbf46 is going to be created. [ 1006.604555] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.604775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.604858] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.605049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.605286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.618829] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: IN_PROGRESS for 2s [ 1006.675843] env[66364]: INFO networking_nsxv3.common.synchronization [req-f398062a-5844-43c0-8fb3-519bae29960d req-3dde96c3-d877-4f76-bd5e-d1fb0d0050ea tempest-ServerGroupTestJSON-1947604458 tempest-ServerGroupTestJSON-1947604458-project-member] Enqueued Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGHEST for action security_group_members [ 1006.676550] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGHEST for action security_group_members [ 1006.676868] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4c406b1-8de5-46fa-bdd6-2eccaf845753 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.676991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.677068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.677267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.677432] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.677531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.677590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.677736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.677820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.677911] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4c406b1-8de5-46fa-bdd6-2eccaf845753',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.758710] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.758710] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.759218] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.759449] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.759982] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.759982] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 0359bd8a-c849-4f67-a5a7-d3f0bfa7356b not found, creating... [ 1006.760375] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.760796] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.760843] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.761953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.761953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.761953] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.761953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.761953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.762453] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.762453] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.762750] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 0359bd8a-c849-4f67-a5a7-d3f0bfa7356b is going to be created. [ 1006.786417] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.786719] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.786861] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.787226] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.787476] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.787784] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.180046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.180259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.180321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.180573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.180687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.180902] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.181039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.181096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.181237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.181318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.181406] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 is going to be updated. [ 1007.214687] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.215057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.215057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.215214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.215273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.228136] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 in Status: IN_PROGRESS for 2s [ 1007.550217] env[66364]: INFO networking_nsxv3.common.synchronization [req-c0fe13ac-b2c2-41b6-aba8-6d26ca0904fa req-ef41dcee-b71c-4342-aabf-c8ab14e4c08b service nova] Enqueued Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_rules [ 1007.550586] env[66364]: INFO networking_nsxv3.common.synchronization [req-c0fe13ac-b2c2-41b6-aba8-6d26ca0904fa req-ef41dcee-b71c-4342-aabf-c8ab14e4c08b service nova] Enqueued Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_members [ 1007.550586] env[66364]: INFO networking_nsxv3.common.synchronization [req-c0fe13ac-b2c2-41b6-aba8-6d26ca0904fa req-ef41dcee-b71c-4342-aabf-c8ab14e4c08b service nova] Enqueued Resource ID: 0359bd8a-c849-4f67-a5a7-d3f0bfa7356b with Priority: HIGHEST for action port [ 1007.551456] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_rules [ 1007.551539] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_members [ 1007.551601] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0359bd8a-c849-4f67-a5a7-d3f0bfa7356b with Priority: HIGHEST for action port [ 1007.552113] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.552438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.552438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.552653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.552758] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.556395] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.557138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.557138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.557138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.557138] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.557138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.557138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.557700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.557700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.557700] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.558588] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.558677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.558677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.558952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.558952] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0359bd8a-c849-4f67-a5a7-d3f0bfa7356b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.064178] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.064178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.064178] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.064178] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0359bd8a-c849-4f67-a5a7-d3f0bfa7356b with status ACTIVE [ 1008.064178] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.064178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.064178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.064178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.064178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.064178] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.064178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.064178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.064178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.064178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.068702] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.068934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.069031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.069299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.069401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.069525] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0359bd8a-c849-4f67-a5a7-d3f0bfa7356b is going to be updated. [ 1008.100038] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.100038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.100038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.100038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.100038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.100038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0359bd8a-c849-4f67-a5a7-d3f0bfa7356b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.360717] env[66364]: INFO networking_nsxv3.common.synchronization [req-51e32b1c-8e14-4a36-a851-68e31bd77916 req-719ecd45-843f-4f01-b9e6-4bcd9abfa391 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_members [ 1008.362534] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_members [ 1008.363635] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.363881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.367557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.367557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.367557] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.367557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.367557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.367557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.367557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.367557] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.383690] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1008.385321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.571689] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.635825] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: SUCCESS [ 1008.636153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.811843] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.812072] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.812306] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.812542] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.812843] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.813039] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.813157] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.813411] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.813563] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.813868] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.813980] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.814118] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.814290] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.814460] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.814607] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.814760] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.839765] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.839933] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.840084] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.840261] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.840591] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.840753] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.840873] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.841245] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.841372] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36b30ca7-cc37-4bf1-a1d8-1f3399b39362',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.867402] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.867568] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.867626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.867834] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.867926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.868143] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.868265] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.868307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.868563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.868640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.868722] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc470104-8593-4197-8a42-8965abae6489 already deleted. [ 1008.868801] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.076366] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.076366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.076366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.076366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.076699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.076699] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40420088-ac97-4318-add0-c3b84e42921a is going to be created. [ 1009.103277] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.103461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.103510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.103874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.103874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.114516] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40420088-ac97-4318-add0-c3b84e42921a in Status: UNINITIALIZED for 2s [ 1009.241631] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 in Status: SUCCESS [ 1009.241631] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 deletion is rescheduled due to dependency. [ 1009.241631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.344999] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.344999] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.346035] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.346035] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.346267] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.346572] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 36b30ca7-cc37-4bf1-a1d8-1f3399b39362 not found, creating... [ 1009.347098] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.347176] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.347293] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.347598] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.347748] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.348077] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.348243] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.348434] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.348676] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.348815] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.348963] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 36b30ca7-cc37-4bf1-a1d8-1f3399b39362 is going to be created. [ 1009.371952] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.372188] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.372360] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.372602] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.372912] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.373063] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.146321] env[66364]: INFO networking_nsxv3.common.synchronization [req-51e32b1c-8e14-4a36-a851-68e31bd77916 req-919f5627-0bfb-4793-ae7b-ffe24a697df1 service nova] Enqueued Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_rules [ 1010.146652] env[66364]: INFO networking_nsxv3.common.synchronization [req-51e32b1c-8e14-4a36-a851-68e31bd77916 req-919f5627-0bfb-4793-ae7b-ffe24a697df1 service nova] Enqueued Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_members [ 1010.146749] env[66364]: INFO networking_nsxv3.common.synchronization [req-51e32b1c-8e14-4a36-a851-68e31bd77916 req-919f5627-0bfb-4793-ae7b-ffe24a697df1 service nova] Enqueued Resource ID: 36b30ca7-cc37-4bf1-a1d8-1f3399b39362 with Priority: HIGHEST for action port [ 1010.147820] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_rules [ 1010.147978] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_members [ 1010.148370] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b30ca7-cc37-4bf1-a1d8-1f3399b39362 with Priority: HIGHEST for action port [ 1010.149609] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.150277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.150408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.150725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.150862] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.154397] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.154397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.154614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.154660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.154828] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.154929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.154981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.155214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.155359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.155475] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.156470] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.156683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.156796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.156866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.156939] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36b30ca7-cc37-4bf1-a1d8-1f3399b39362',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.655813] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.655813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.661311] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.666099] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36b30ca7-cc37-4bf1-a1d8-1f3399b39362 with status ACTIVE [ 1010.666421] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.666620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.666700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.666999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.667103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.667293] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.667429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.667521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.667766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.667877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.668924] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.668924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.668924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.668924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.668924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.668924] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36b30ca7-cc37-4bf1-a1d8-1f3399b39362 is going to be updated. [ 1010.695217] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.696515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.696515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.696515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.696984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.696984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36b30ca7-cc37-4bf1-a1d8-1f3399b39362" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.126141] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40420088-ac97-4318-add0-c3b84e42921a in Status: SUCCESS [ 1011.126376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.126545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.126781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.127072] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.127200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.127264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.127432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.127516] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.127636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.127687] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.166476] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.630264] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.669445] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.669445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.669445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.669891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.669891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.669891] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc470104-8593-4197-8a42-8965abae6489 is going to be created. [ 1011.701268] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.701480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.701542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.701792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.702355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.717350] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc470104-8593-4197-8a42-8965abae6489 in Status: UNINITIALIZED for 2s [ 1012.133776] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40420088-ac97-4318-add0-c3b84e42921a: rpc.has_security_group_logging(os_id): False [ 1012.156508] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.156765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.156765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.156914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.157044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.157354] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.157424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.157424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.157599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.157681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.157765] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40420088-ac97-4318-add0-c3b84e42921a is going to be created. [ 1012.239716] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.240243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.240243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.240243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.240445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.257417] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40420088-ac97-4318-add0-c3b84e42921a in Status: IN_PROGRESS for 2s [ 1013.387522] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1013.387958] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NSXv3 Agent Agent loop - iteration:2 started [ 1013.729146] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc470104-8593-4197-8a42-8965abae6489 in Status: SUCCESS [ 1013.729146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.729146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.729146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.729146] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.729146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.729146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.729609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.729609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.729609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.729609] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.231485] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.273054] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40420088-ac97-4318-add0-c3b84e42921a in Status: SUCCESS [ 1014.276027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.733574] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc470104-8593-4197-8a42-8965abae6489: rpc.has_security_group_logging(os_id): False [ 1014.752986] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.752986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.753193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.753235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.753343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.753554] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.753654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.753719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.753881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.753953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.754440] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc470104-8593-4197-8a42-8965abae6489 is going to be created. [ 1014.835037] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.835256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.835345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.835575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.835766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.850862] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc470104-8593-4197-8a42-8965abae6489 in Status: IN_PROGRESS for 2s [ 1015.150464] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1015.150663] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1016.865055] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc470104-8593-4197-8a42-8965abae6489 in Status: SUCCESS [ 1016.865055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.461247] env[66364]: INFO networking_nsxv3.common.synchronization [req-a6a25b14-5d31-4648-9eac-e8d19529ff40 req-a4c7a625-9cfd-47d4-9363-00817e96fc44 tempest-ServerPasswordTestJSON-329435725 tempest-ServerPasswordTestJSON-329435725-project-member] Enqueued Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGHEST for action security_group_members [ 1017.461247] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGHEST for action security_group_members [ 1017.461418] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a60439-2347-4fe5-b9fc-114855fd5d38 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.461538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.461967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.462335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.462545] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.462678] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.462763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.462956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.463089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.463203] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a60439-2347-4fe5-b9fc-114855fd5d38',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.941143] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.941500] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-314" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.941548] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-314" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.941955] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-314" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.942282] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.943034] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.943034] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.943034] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.943201] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.943825] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.943825] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.943825] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.943825] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.943825] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.944297] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.944297] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.965294] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.965294] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1017.965294] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.965294] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-314" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.965830] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.965830] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.965830] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.966479] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.966479] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e40d80-6547-464d-ad8a-1ecc3d1cc6e4',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.967335] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.967499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.967499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.967745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.967745] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.967937] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.968055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.968133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.968240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.969807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.969807] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 already deleted. [ 1017.969807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.473024] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.473024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.473024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.473024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.473024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.473024] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 35e40d80-6547-464d-ad8a-1ecc3d1cc6e4 not found, creating... [ 1018.473024] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.473024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.473024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.473024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.473024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.473811] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.473811] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.473811] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.474281] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.474601] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.474862] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 35e40d80-6547-464d-ad8a-1ecc3d1cc6e4 is going to be created. [ 1018.497551] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.497772] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.497873] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.498184] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.498442] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.498938] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.203218] env[66364]: INFO networking_nsxv3.common.synchronization [None req-92d36023-dad8-411f-bf9c-32779009db70 None None] Enqueued Resource ID: 21560c91-8769-49f6-802f-b777115304ae with Priority: HIGHEST for action port [ 1019.204141] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21560c91-8769-49f6-802f-b777115304ae with Priority: HIGHEST for action port [ 1019.208633] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-21560c91-8769-49f6-802f-b777115304ae taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.209067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21560c91-8769-49f6-802f-b777115304ae" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.209067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21560c91-8769-49f6-802f-b777115304ae" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.209165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21560c91-8769-49f6-802f-b777115304ae" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.209213] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21560c91-8769-49f6-802f-b777115304ae',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.214490] env[66364]: INFO networking_nsxv3.common.synchronization [req-a6a25b14-5d31-4648-9eac-e8d19529ff40 req-083690ec-9b51-421b-bb41-0b32aad09c1a service nova] Enqueued Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGHEST for action security_group_rules [ 1019.214807] env[66364]: INFO networking_nsxv3.common.synchronization [req-a6a25b14-5d31-4648-9eac-e8d19529ff40 req-083690ec-9b51-421b-bb41-0b32aad09c1a service nova] Enqueued Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGHEST for action security_group_members [ 1019.214807] env[66364]: INFO networking_nsxv3.common.synchronization [req-a6a25b14-5d31-4648-9eac-e8d19529ff40 req-083690ec-9b51-421b-bb41-0b32aad09c1a service nova] Enqueued Resource ID: 35e40d80-6547-464d-ad8a-1ecc3d1cc6e4 with Priority: HIGHEST for action port [ 1019.215692] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGHEST for action security_group_rules [ 1019.215815] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGHEST for action security_group_members [ 1019.216023] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e40d80-6547-464d-ad8a-1ecc3d1cc6e4 with Priority: HIGHEST for action port [ 1019.216200] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15a60439-2347-4fe5-b9fc-114855fd5d38 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.216324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.216387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.216656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.217035] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15a60439-2347-4fe5-b9fc-114855fd5d38',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.217665] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a60439-2347-4fe5-b9fc-114855fd5d38 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.217775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.217838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.218038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.218474] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.219786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.219786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.219786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.219786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.219786] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a60439-2347-4fe5-b9fc-114855fd5d38',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.221126] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.221126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.221288] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.221363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.221447] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35e40d80-6547-464d-ad8a-1ecc3d1cc6e4',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.716349] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21560c91-8769-49f6-802f-b777115304ae [ 1019.716624] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.716725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.716829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.717305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.717444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.719020] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21560c91-8769-49f6-802f-b777115304ae already deleted. [ 1019.719020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21560c91-8769-49f6-802f-b777115304ae" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.723126] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a60439-2347-4fe5-b9fc-114855fd5d38 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.723351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.723579] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15a60439-2347-4fe5-b9fc-114855fd5d38',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.724610] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35e40d80-6547-464d-ad8a-1ecc3d1cc6e4 with status ACTIVE [ 1019.724800] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.724916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.726821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.726821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.726821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.726821] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.726821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.726821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.726821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.726821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.726821] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.726821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.726821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.727411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.728177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.728688] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35e40d80-6547-464d-ad8a-1ecc3d1cc6e4 is going to be updated. [ 1019.750673] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.750755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.750859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.751123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.751273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.751434] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35e40d80-6547-464d-ad8a-1ecc3d1cc6e4" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.231225] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15a60439-2347-4fe5-b9fc-114855fd5d38',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.734183] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.734183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.734183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.734343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.734497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.734667] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 is going to be created. [ 1020.759861] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.760039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.760112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.760322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.760482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.770848] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 in Status: UNINITIALIZED for 2s [ 1021.664193] env[66364]: INFO networking_nsxv3.common.synchronization [None req-88454ffc-bd16-438b-9967-fd87d48c292b None None] Enqueued Resource ID: 76bf7b27-caad-421c-ada4-0300764f8e7b with Priority: HIGHEST for action port [ 1021.664193] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76bf7b27-caad-421c-ada4-0300764f8e7b with Priority: HIGHEST for action port [ 1021.664193] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-76bf7b27-caad-421c-ada4-0300764f8e7b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.664193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76bf7b27-caad-421c-ada4-0300764f8e7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.664193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76bf7b27-caad-421c-ada4-0300764f8e7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.666847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76bf7b27-caad-421c-ada4-0300764f8e7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.666847] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76bf7b27-caad-421c-ada4-0300764f8e7b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.802326] env[66364]: INFO networking_nsxv3.common.synchronization [req-f6de15ec-91de-40c0-8f3d-3ae814a5311e req-c9c39853-ede8-40cd-825a-c634e09bac39 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_members [ 1021.802855] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_members [ 1021.803167] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d452681b-1b53-41c8-868e-1a2a30ac3a1f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.803471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.803471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.803593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.803744] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.804198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.804198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.804503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.804630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.804770] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.170388] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76bf7b27-caad-421c-ada4-0300764f8e7b [ 1022.170623] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.170770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.171125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.171125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.171125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.171280] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76bf7b27-caad-421c-ada4-0300764f8e7b already deleted. [ 1022.171280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76bf7b27-caad-421c-ada4-0300764f8e7b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.226246] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.226246] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.226246] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.226531] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.226586] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.226759] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.226884] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.227123] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.227262] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.228963] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.228963] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.228963] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.228963] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.228963] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.228963] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.228963] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.250503] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.250952] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.253018] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.253018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.253018] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-bb502592-72c4-4cab-ab1f-dea400dc9158 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.253018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-bb502592-72c4-4cab-ab1f-dea400dc9158" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.253018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-bb502592-72c4-4cab-ab1f-dea400dc9158" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.253018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-bb502592-72c4-4cab-ab1f-dea400dc9158" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.253018] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb502592-72c4-4cab-ab1f-dea400dc9158',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.307862] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.307862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.307862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.308169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.308169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.308333] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.308460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.308524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.308712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.308810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.312022] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f already deleted. [ 1022.312022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.757191] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.757491] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.757628] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.757919] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.758088] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.758250] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port bb502592-72c4-4cab-ab1f-dea400dc9158 not found, creating... [ 1022.758514] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.758699] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.758786] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.759013] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.759153] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.759423] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.759577] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.759688] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.759887] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.760038] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.760183] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: bb502592-72c4-4cab-ab1f-dea400dc9158 is going to be created. [ 1022.783328] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.783328] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.783328] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.783328] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.783328] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.783328] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-bb502592-72c4-4cab-ab1f-dea400dc9158" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.784044] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 in Status: SUCCESS [ 1022.784235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.784411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.784580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.784752] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.784853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.784907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.785089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.785145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.785249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.785839] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15a60439-2347-4fe5-b9fc-114855fd5d38',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.291678] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a60439-2347-4fe5-b9fc-114855fd5d38 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.291846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.291914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.292167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.292487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.292487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.292640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.292676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.292768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.292851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.293007] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a60439-2347-4fe5-b9fc-114855fd5d38 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.293107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.293160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.293305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.293445] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.293569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.293603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.293719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.293793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.293871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.293988] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15a60439-2347-4fe5-b9fc-114855fd5d38',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.540736] env[66364]: INFO networking_nsxv3.common.synchronization [req-f6de15ec-91de-40c0-8f3d-3ae814a5311e req-4a7ca334-fbd6-47e8-9273-d368f0da24aa service nova] Enqueued Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_rules [ 1023.540736] env[66364]: INFO networking_nsxv3.common.synchronization [req-f6de15ec-91de-40c0-8f3d-3ae814a5311e req-4a7ca334-fbd6-47e8-9273-d368f0da24aa service nova] Enqueued Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_members [ 1023.540736] env[66364]: INFO networking_nsxv3.common.synchronization [req-f6de15ec-91de-40c0-8f3d-3ae814a5311e req-4a7ca334-fbd6-47e8-9273-d368f0da24aa service nova] Enqueued Resource ID: bb502592-72c4-4cab-ab1f-dea400dc9158 with Priority: HIGHEST for action port [ 1023.541389] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_rules [ 1023.541561] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_members [ 1023.541656] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb502592-72c4-4cab-ab1f-dea400dc9158 with Priority: HIGHEST for action port [ 1023.541987] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.542530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.542692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.543061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.543218] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.544223] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d452681b-1b53-41c8-868e-1a2a30ac3a1f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.545024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.545024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.545024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.545024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.545024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.545024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.545459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.545556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.545680] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.547199] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb502592-72c4-4cab-ab1f-dea400dc9158 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.547346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb502592-72c4-4cab-ab1f-dea400dc9158" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.547439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb502592-72c4-4cab-ab1f-dea400dc9158" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.547624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb502592-72c4-4cab-ab1f-dea400dc9158" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.547742] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb502592-72c4-4cab-ab1f-dea400dc9158',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.800074] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15a60439-2347-4fe5-b9fc-114855fd5d38: rpc.has_security_group_logging(os_id): False [ 1023.822683] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.822683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.822884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.823046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.823090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.823857] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.823857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.823857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.823857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.823857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.823857] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.824121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.824121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.824121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.824208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.824376] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.824588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.824588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.824787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.824787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.824787] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 is going to be created. [ 1023.894063] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.894063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.894343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.894343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.894543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.909614] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 in Status: IN_PROGRESS for 2s [ 1024.047863] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.049087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d452681b-1b53-41c8-868e-1a2a30ac3a1f taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.049359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.050060] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb502592-72c4-4cab-ab1f-dea400dc9158 with status ACTIVE [ 1024.050374] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.050589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.050683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.050987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.051155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.051429] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.051594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.051695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.051957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.052117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.052450] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.052613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.052718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.052954] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.053197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.053347] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb502592-72c4-4cab-ab1f-dea400dc9158 is going to be updated. [ 1024.078031] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.078031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.078337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.078392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.078530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.078707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb502592-72c4-4cab-ab1f-dea400dc9158" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.550954] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.053924] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.054381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.054381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.054381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.054558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.054690] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f is going to be created. [ 1025.092404] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.092657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.092657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.092888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.093058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.103079] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f in Status: UNINITIALIZED for 2s [ 1025.923673] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 in Status: SUCCESS [ 1025.923673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.597787] env[66364]: INFO networking_nsxv3.common.synchronization [req-980b539d-89cb-48aa-9228-82e4c494ee1e req-76115634-40f3-4dab-8c36-7e07b91012c3 tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1026.598423] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1026.598745] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.598870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.598937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.599164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.599310] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.599406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.599465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.599615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.599699] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.599794] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.920997] env[66364]: INFO networking_nsxv3.common.synchronization [req-242a77c7-c571-4c3c-9ddd-728b43983483 req-d925d5b3-c0bb-4fe9-b418-41d83a2696d3 tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1026.921888] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1026.922279] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.922405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.922484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.922696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.922858] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.922983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.923280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.923553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.923659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.923700] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.102232] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.102543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.102638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.102938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.103092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.103637] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.103637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.103637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.103844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.103953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.104105] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1027.130719] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f in Status: SUCCESS [ 1027.130719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.130719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.130719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.130719] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.130719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.130719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.130719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.130719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.130719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.130719] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.148791] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.148984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.149103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.149332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.149493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.161866] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1027.426606] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.426877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.426962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.427345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.427345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.427512] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.428177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.428177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.428177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.428177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.428177] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1027.464725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.464969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.464969] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.465232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.465425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.482297] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1027.633309] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.136841] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d452681b-1b53-41c8-868e-1a2a30ac3a1f: rpc.has_security_group_logging(os_id): False [ 1028.156196] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.156342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.156420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.156688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.156688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.156928] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.157056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.157121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.157327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.157327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.157490] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f is going to be created. [ 1028.225025] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.225025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.225025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.225025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.225025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.239376] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f in Status: IN_PROGRESS for 2s [ 1029.174043] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1029.174406] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 1029.174406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.493417] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1029.493417] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d deletion is rescheduled due to dependency. [ 1029.493417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.256180] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f in Status: SUCCESS [ 1030.256439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.332144] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.332471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.332471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.332727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.332850] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.835752] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.903603] env[66364]: INFO networking_nsxv3.common.synchronization [req-afac5504-cae7-4dd2-ad88-a421760410cf req-2d7f6bcb-d933-4164-89bc-5ca123f57a49 tempest-ServerRescueNegativeTestJSON-1330136755 tempest-ServerRescueNegativeTestJSON-1330136755-project-member] Enqueued Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1030.904074] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1030.904409] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.904602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.904602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.904857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.905024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.905124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.905182] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.905331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.905437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.905606] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.265031] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.265031] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.265031] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.266262] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.266845] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.269526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.269526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.269526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.269526] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.269526] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.269526] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.269526] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.270612] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.270612] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.270612] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.271170] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.293059] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.293315] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.293315] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.293483] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.293953] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-1d7b3823-d3af-40ea-aa1f-89c86de52b98 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.294269] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-1d7b3823-d3af-40ea-aa1f-89c86de52b98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.294911] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-1d7b3823-d3af-40ea-aa1f-89c86de52b98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.295369] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-1d7b3823-d3af-40ea-aa1f-89c86de52b98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.295369] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d7b3823-d3af-40ea-aa1f-89c86de52b98',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.338431] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.409589] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.409755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.409818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.410067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.410340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.410340] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.410510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.410510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.410691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.410928] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.411215] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 already deleted. [ 1031.411215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.798327] env[66364]: INFO networking_nsxv3.common.synchronization [req-80e3f208-1dec-43d6-b31c-5f1199b1e83c req-6fe94ca5-2420-4e85-ba6b-04a7f8dbd0b0 tempest-ServerPasswordTestJSON-329435725 tempest-ServerPasswordTestJSON-329435725-project-member] Enqueued Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGHEST for action security_group_members [ 1031.798838] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.799030] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.799158] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.799426] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.799564] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.799738] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 1d7b3823-d3af-40ea-aa1f-89c86de52b98 not found, creating... [ 1031.799999] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.800172] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.800288] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.800510] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.800651] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.800923] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.801092] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.801211] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.801416] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.801547] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.801685] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 1d7b3823-d3af-40ea-aa1f-89c86de52b98 is going to be created. [ 1031.803024] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGHEST for action security_group_members [ 1031.803314] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-15a60439-2347-4fe5-b9fc-114855fd5d38 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.803422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.803485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.803637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.803778] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.803871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.803930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.804085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.804164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.804250] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15a60439-2347-4fe5-b9fc-114855fd5d38',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.824277] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.824547] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.824696] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.824970] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.825221] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.825522] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-1d7b3823-d3af-40ea-aa1f-89c86de52b98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.841254] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1031.841254] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1032.307564] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.307564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.307995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.307995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.307995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.308236] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.308341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.308404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.308568] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.308651] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.308738] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 is going to be updated. [ 1032.337399] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.337556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.337658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.337832] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.337976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.350461] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 in Status: IN_PROGRESS for 2s [ 1032.564269] env[66364]: INFO networking_nsxv3.common.synchronization [req-afac5504-cae7-4dd2-ad88-a421760410cf req-47637820-9b48-47fb-bcb0-f6f8c0a655f4 service nova] Enqueued Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_rules [ 1032.564543] env[66364]: INFO networking_nsxv3.common.synchronization [req-afac5504-cae7-4dd2-ad88-a421760410cf req-47637820-9b48-47fb-bcb0-f6f8c0a655f4 service nova] Enqueued Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1032.564867] env[66364]: INFO networking_nsxv3.common.synchronization [req-afac5504-cae7-4dd2-ad88-a421760410cf req-47637820-9b48-47fb-bcb0-f6f8c0a655f4 service nova] Enqueued Resource ID: 1d7b3823-d3af-40ea-aa1f-89c86de52b98 with Priority: HIGHEST for action port [ 1032.565548] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_rules [ 1032.565791] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1032.565928] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d7b3823-d3af-40ea-aa1f-89c86de52b98 with Priority: HIGHEST for action port [ 1032.566369] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.566579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.566693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.567065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.567215] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.568385] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.568592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.568722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.568989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.569209] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.569350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.569433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.569627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.569744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.569871] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.571241] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d7b3823-d3af-40ea-aa1f-89c86de52b98 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.571241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d7b3823-d3af-40ea-aa1f-89c86de52b98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.571241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d7b3823-d3af-40ea-aa1f-89c86de52b98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.571388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d7b3823-d3af-40ea-aa1f-89c86de52b98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.571485] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d7b3823-d3af-40ea-aa1f-89c86de52b98',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.850907] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.850907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.850907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.851144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.864161] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1032.865351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.867023] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1032.905700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.905874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.905951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.906176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.917304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.918122] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1032.918239] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1032.918361] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1032.973928] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.974190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.974253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.974452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.976192] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.976422] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1033.073739] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.075851] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.075851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.075851] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d7b3823-d3af-40ea-aa1f-89c86de52b98 with status ACTIVE [ 1033.075851] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.075851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.075851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.075851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.075851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.076213] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.076213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.076213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.077974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.077974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.077974] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.077974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.077974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.077974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.077974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.077974] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d7b3823-d3af-40ea-aa1f-89c86de52b98 is going to be updated. [ 1033.083371] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.083734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.083881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.084110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.084559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.084866] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1033.098716] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.098926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.099055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.099314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.099504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.099738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d7b3823-d3af-40ea-aa1f-89c86de52b98" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.267735] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.267955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.267955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.268179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.268442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.268712] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 1033.268807] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c4749461-177d-4d2d-9817-47596fbff3b5', '40420088-ac97-4318-add0-c3b84e42921a', 'ad194291-e1d7-48e3-b3d4-5e26a902dc4b', '15a60439-2347-4fe5-b9fc-114855fd5d38', 'ebb41e34-3a6d-4c7e-a19c-48afdcc86d62', '4d9f4a86-c2b4-40ed-8c1d-651067e33449', '5028084e-cee8-4d90-822e-92c0b2a9224a', 'c98b6c22-a778-4b7a-8143-b67c9c0e3eef', '779e6414-54c4-4ab2-8678-8a31896ce93c', '2ae9b572-f2b7-43ae-9076-285c394304b7', 'b49ee1f8-75f0-4dc8-86a3-69683601a19d', '97a7651b-f7fd-4861-bb60-9879cd8461c2', '2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8', 'dc470104-8593-4197-8a42-8965abae6489', 'd32f784a-4b9d-4ad9-8cac-3dcf099fea9c', '3a00587d-7e00-43fa-be8e-c9edb939cd26', 'df21da4b-98ac-4bfa-b751-65483a460873', '00f488e0-b3c6-4d70-9a6d-d812a7003523', 'a0ef17dd-12b4-4751-91bb-321b509b882e', '622b5ca5-0010-4122-b9d4-901a52d1aa5c', 'd4c406b1-8de5-46fa-bdd6-2eccaf845753', 'f6d923ea-108c-4ea6-b072-aa5974291da3', '665d57cc-5dea-494f-b1df-651330cfd64a', '784e3e36-fad9-4cd6-a173-77329b5f03c2', '3a79a858-0e03-4c0f-8127-6d5008465f85', 'a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d', '02c59c8a-da67-420a-8de3-ef613658b83d', 'cb447688-9fc5-4154-bc02-69edb9629669', 'edc73d65-12db-4adf-90af-f7bd6b67d4fd', '37506c58-083d-46d9-8010-be6545a2e954', 'caf65fab-7b8a-4ed0-8b20-496896e11d68', '85f93bd5-5dca-472e-a30a-fd77d873bad8', 'bb1df802-a3f1-4c8d-a6da-037dbf31eedb', '5165fdef-bf23-471f-87fc-3248cc2d9078', '2ce5e068-6071-492c-83e7-d1b6b7551653', 'a80c29ba-9fac-4002-9bc5-2c6f28eafc86', 'c50ff812-f9eb-4476-8c5b-45d3cc1a4532', 'f0345151-3287-4add-b6b3-bbb72460c6bd', '64957bc0-2496-43d3-8cbd-8653bab5f68b', '9733c7ac-eb57-4467-8d19-d151daebf568', 'd452681b-1b53-41c8-868e-1a2a30ac3a1f', 'bb1358a0-c55b-4cc7-8303-f2d79335b98a', '52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789', 'a59a352e-2737-4849-9aff-a8ce9ffcd13d', '8d105259-6c05-4d26-aa23-5631556fbf46', '296f3936-dac0-44a8-a46a-d39ee062c69f', '6b563fa6-e694-4628-a9da-1beb0ee48864', '00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7', 'e327b378-51f2-4bc5-8b1c-697b0302c4a5', '007f96f6-a408-4a76-b5c6-eceae8238916'} {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1033.268904] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1033.300571] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.300941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.301086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.301321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.301413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.301530] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1033.301605] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1033.301674] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1033.432174] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.432713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.432713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.432713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.434393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.434813] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1033.434923] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1033.435033] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1033.435131] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1033.435245] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 1033.435348] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGH for action security_group_rules [ 1033.435459] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGH for action security_group_rules [ 1033.435559] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGH for action security_group_rules [ 1033.435652] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGH for action security_group_rules [ 1033.435737] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGH for action security_group_rules [ 1033.435816] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGH for action security_group_rules [ 1033.435887] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGH for action security_group_rules [ 1033.435969] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGH for action security_group_rules [ 1033.436077] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGH for action security_group_rules [ 1033.436151] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGH for action security_group_rules [ 1033.436236] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGH for action security_group_rules [ 1033.436314] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGH for action security_group_rules [ 1033.436395] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGH for action security_group_rules [ 1033.436474] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGH for action security_group_rules [ 1033.436559] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGH for action security_group_rules [ 1033.436645] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGH for action security_group_rules [ 1033.436729] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGH for action security_group_rules [ 1033.436831] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGH for action security_group_rules [ 1033.436934] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGH for action security_group_rules [ 1033.436979] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGH for action security_group_rules [ 1033.437128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.579186] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.081848] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.082134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.082134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.082506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.082959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.082959] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 is going to be created. [ 1034.114456] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.114779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.114915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.115298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.115444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.128459] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: UNINITIALIZED for 2s [ 1034.323022] env[66364]: INFO networking_nsxv3.common.synchronization [req-56f687fd-1766-47c5-b83b-b7d195d8db88 req-58f5aaf4-8462-4d94-924f-6b3a42efac8b tempest-ServerRescueNegativeTestJSON-1330136755 tempest-ServerRescueNegativeTestJSON-1330136755-project-member] Enqueued Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1034.323626] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1034.323783] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4749461-177d-4d2d-9817-47596fbff3b5 with Priority: HIGH for action security_group_rules [ 1034.323887] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGH for action security_group_rules [ 1034.323983] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGH for action security_group_rules [ 1034.324113] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGH for action security_group_rules [ 1034.324235] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGH for action security_group_rules [ 1034.324327] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ef17dd-12b4-4751-91bb-321b509b882e with Priority: HIGH for action security_group_rules [ 1034.324416] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 with Priority: HIGH for action security_group_rules [ 1034.324562] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df21da4b-98ac-4bfa-b751-65483a460873 with Priority: HIGH for action security_group_rules [ 1034.324676] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGH for action security_group_rules [ 1034.324766] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 with Priority: HIGH for action security_group_rules [ 1034.324853] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 with Priority: HIGH for action security_group_rules [ 1034.324941] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 with Priority: HIGH for action security_group_rules [ 1034.325037] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGH for action security_group_rules [ 1034.325125] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 with Priority: HIGH for action security_group_rules [ 1034.325209] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 779e6414-54c4-4ab2-8678-8a31896ce93c with Priority: HIGH for action security_group_rules [ 1034.325295] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 with Priority: HIGH for action security_group_rules [ 1034.325379] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef with Priority: HIGH for action security_group_rules [ 1034.325461] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 with Priority: HIGH for action security_group_rules [ 1034.325638] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGH for action security_group_rules [ 1034.325756] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 with Priority: HIGH for action security_group_rules [ 1034.326109] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.326179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.326350] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4749461-177d-4d2d-9817-47596fbff3b5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.326420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.326534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.326725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.326812] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4749461-177d-4d2d-9817-47596fbff3b5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.328428] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.328428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.328634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.328750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.329014] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.331289] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.331289] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.331289] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.331737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.331860] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.333141] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.333303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.333436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.334023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.334023] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.334924] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.335726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.335726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.335726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.335726] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.338561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0ef17dd-12b4-4751-91bb-321b509b882e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.338561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.338561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.338561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.338561] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0ef17dd-12b4-4751-91bb-321b509b882e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.338561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f488e0-b3c6-4d70-9a6d-d812a7003523 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.338891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.338939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.339187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.339295] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f488e0-b3c6-4d70-9a6d-d812a7003523',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.340577] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df21da4b-98ac-4bfa-b751-65483a460873 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.340577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.340577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.340761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.340830] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df21da4b-98ac-4bfa-b751-65483a460873',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.341820] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.341982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.342086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.342298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.342403] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.343482] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a00587d-7e00-43fa-be8e-c9edb939cd26 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.343655] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.343805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.344009] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.344126] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a00587d-7e00-43fa-be8e-c9edb939cd26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.345681] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.345681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.345681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.345681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.345883] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.346725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-97a7651b-f7fd-4861-bb60-9879cd8461c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.346859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.346943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.347317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.347780] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('97a7651b-f7fd-4861-bb60-9879cd8461c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.348528] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.348694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.348799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.349024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.349125] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.350078] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ae9b572-f2b7-43ae-9076-285c394304b7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.350460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.350460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.350564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.350666] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ae9b572-f2b7-43ae-9076-285c394304b7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.351579] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-779e6414-54c4-4ab2-8678-8a31896ce93c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.351754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.351839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.352038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.352143] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('779e6414-54c4-4ab2-8678-8a31896ce93c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.354435] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.354596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.354733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.354912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.355024] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d9f4a86-c2b4-40ed-8c1d-651067e33449',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.356107] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.356261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.356356] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.356566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.357341] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c98b6c22-a778-4b7a-8143-b67c9c0e3eef',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.358390] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.358500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.358562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.358883] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.358984] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ebb41e34-3a6d-4c7e-a19c-48afdcc86d62',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.359679] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.359786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.359851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.360017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.360085] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.360852] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15a60439-2347-4fe5-b9fc-114855fd5d38 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.361016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.361016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.361171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.361239] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15a60439-2347-4fe5-b9fc-114855fd5d38',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.380093] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 in Status: SUCCESS [ 1034.380555] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 deletion is rescheduled due to dependency. [ 1034.380555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.385247] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.385567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.385567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.385936] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.411957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.411957] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4749461-177d-4d2d-9817-47596fbff3b5 is going to be deleted. [ 1034.480126] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.480126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.480126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.480126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.480126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.480126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4749461-177d-4d2d-9817-47596fbff3b5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.687832] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.688142] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.688366] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.688804] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.689172] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.689418] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.689634] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.689943] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.690157] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.690472] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.690867] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.691082] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.691517] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.691517] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.691615] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.691831] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.716886] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.717194] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.717350] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.717665] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.717890] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-472bc109-47c4-4346-8abb-d08340fc85a8 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.718164] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-472bc109-47c4-4346-8abb-d08340fc85a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.718376] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-472bc109-47c4-4346-8abb-d08340fc85a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.718705] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-472bc109-47c4-4346-8abb-d08340fc85a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.718845] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('472bc109-47c4-4346-8abb-d08340fc85a8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.863770] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.863770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.863770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.863983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.863983] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.864084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.864121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.864258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.864336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.865434] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.865434] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.876300] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.876300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.876300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.876300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.876300] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.876609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.876609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.876609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.876710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.876870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.876973] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.877855] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.877963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.878040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.878192] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.878334] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.878427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.878485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.878648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.878733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.878895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.878979] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.885838] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.885971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.886033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.886219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.894239] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.894380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.894486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.894705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.894866] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.894965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.895038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.895187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.895269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.895352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.895435] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.937682] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.937862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.938712] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.938840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.947728] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.947865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.950243] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.950393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.951212] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.951329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.952199] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.952288] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.953281] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.953402] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.954206] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.954358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.955082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.955192] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 779e6414-54c4-4ab2-8678-8a31896ce93c is going to be deleted. [ 1034.956684] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.956791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.956863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.957076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.958467] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.958623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.959234] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.959329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.959933] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1034.960322] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.960433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.961896] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1034.962044] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.962135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.962743] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1034.963139] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.963239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.981109] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1034.981612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.981744] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d9f4a86-c2b4-40ed-8c1d-651067e33449 is going to be deleted. [ 1034.982804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.982974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.999450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.999588] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df21da4b-98ac-4bfa-b751-65483a460873 is going to be deleted. [ 1035.000582] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.000670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.022075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.022261] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be deleted. [ 1035.023311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.023545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.045749] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.045749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.047958] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.047958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.053498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.053498] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ebb41e34-3a6d-4c7e-a19c-48afdcc86d62 is going to be deleted. [ 1035.054371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.054547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.076922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.077055] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ae9b572-f2b7-43ae-9076-285c394304b7 is going to be deleted. [ 1035.077874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.078097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.109461] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.109679] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.115765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.115923] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c98b6c22-a778-4b7a-8143-b67c9c0e3eef is going to be deleted. [ 1035.116902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.117130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.118526] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.118628] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.134284] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.134434] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.158506] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.158675] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f488e0-b3c6-4d70-9a6d-d812a7003523 is going to be deleted. [ 1035.159983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.160186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.212765] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.213014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.213906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.214041] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0ef17dd-12b4-4751-91bb-321b509b882e is going to be deleted. [ 1035.215068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.215401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.221679] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.221887] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.222019] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.222301] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.222448] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.222598] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 472bc109-47c4-4346-8abb-d08340fc85a8 not found, creating... [ 1035.222856] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.223025] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.223166] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.223401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.223538] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.223814] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.223970] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.224097] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.224305] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.224437] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.224602] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 472bc109-47c4-4346-8abb-d08340fc85a8 is going to be created. [ 1035.286485] env[66364]: INFO networking_nsxv3.common.synchronization [req-a3c64bdf-8c33-46eb-a011-851d65012bd5 req-5190b63b-8b18-4268-b2f9-d59f3181afe6 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_members [ 1035.287442] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGHEST for action security_group_members [ 1035.287915] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-665d57cc-5dea-494f-b1df-651330cfd64a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.288089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.288178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.288435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.288631] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.288792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.288853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.289037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.289151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.289269] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.306210] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.306429] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a00587d-7e00-43fa-be8e-c9edb939cd26 is going to be deleted. [ 1035.307338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.307627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.348017] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.348308] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.348401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.348687] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.348938] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.349188] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-472bc109-47c4-4346-8abb-d08340fc85a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.351785] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.351932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.370336] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.370562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.388175] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.389212] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.390152] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.398459] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.403861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.403861] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 97a7651b-f7fd-4861-bb60-9879cd8461c2 is going to be deleted. [ 1035.404188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.404565] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.462964] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.462964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.464375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.464556] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be deleted. [ 1035.465463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.465744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.525403] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.525403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.541572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.541795] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8 is going to be deleted. [ 1035.543419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.543691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.566598] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.566802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.590131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.590537] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15a60439-2347-4fe5-b9fc-114855fd5d38 is going to be deleted. [ 1035.592255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.594043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.662037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.663168] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be deleted. [ 1035.663863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.663863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.663863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.663863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d9f4a86-c2b4-40ed-8c1d-651067e33449" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.664056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.664229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.664310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.664480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-779e6414-54c4-4ab2-8678-8a31896ce93c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.665689] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.665809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.665857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.666040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.666124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.666238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.666365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.666511] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.666588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.666717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df21da4b-98ac-4bfa-b751-65483a460873" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.666795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.666971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.667539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.667685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.667685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.667833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.667911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.668034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ebb41e34-3a6d-4c7e-a19c-48afdcc86d62" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.668145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.668285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.668358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.668464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ae9b572-f2b7-43ae-9076-285c394304b7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.668590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.668729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.668798] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.668902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c98b6c22-a778-4b7a-8143-b67c9c0e3eef" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.669016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.669152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.669316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.669316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f488e0-b3c6-4d70-9a6d-d812a7003523" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.669631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.669631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.669631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.669785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0ef17dd-12b4-4751-91bb-321b509b882e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.669824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.669947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.670038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.670140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a00587d-7e00-43fa-be8e-c9edb939cd26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.670261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.670394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.670463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.670570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-97a7651b-f7fd-4861-bb60-9879cd8461c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.727603] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.727792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.727885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.729158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.729158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.729158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c6313d7-6c5a-4c70-8cc6-a73f846fc0e8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.774561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.774736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.774781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.774991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.775110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.775209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15a60439-2347-4fe5-b9fc-114855fd5d38" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.791809] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.792029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.792078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.793243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.804566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.804566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.869504] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1035.870267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.870375] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.870468] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.870556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.871058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.871058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.871058] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 665d57cc-5dea-494f-b1df-651330cfd64a is going to be updated. [ 1035.871989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.872332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.872498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.872626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.890647] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40420088-ac97-4318-add0-c3b84e42921a: rpc.has_security_group_logging(os_id): False [ 1035.892016] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5028084e-cee8-4d90-822e-92c0b2a9224a: rpc.has_security_group_logging(os_id): False [ 1035.892865] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad194291-e1d7-48e3-b3d4-5e26a902dc4b: rpc.has_security_group_logging(os_id): False [ 1035.899703] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc470104-8593-4197-8a42-8965abae6489: rpc.has_security_group_logging(os_id): False [ 1035.922207] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.922353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.922423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.922696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.924339] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.924478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.944805] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.945011] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.946119] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.946337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.973031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.975045] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.975045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.975045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.975045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.975045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.975045] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc470104-8593-4197-8a42-8965abae6489 is going to be updated. [ 1035.975368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.975368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.976999] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.977157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.977269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.978094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.978094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.994771] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 665d57cc-5dea-494f-b1df-651330cfd64a in Status: IN_PROGRESS for 2s [ 1035.998371] env[66364]: INFO networking_nsxv3.common.synchronization [req-56f687fd-1766-47c5-b83b-b7d195d8db88 req-c4a8b4af-6d29-4749-b309-0c47805d3ea2 service nova] Enqueued Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_rules [ 1035.998554] env[66364]: INFO networking_nsxv3.common.synchronization [req-56f687fd-1766-47c5-b83b-b7d195d8db88 req-c4a8b4af-6d29-4749-b309-0c47805d3ea2 service nova] Enqueued Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1035.998688] env[66364]: INFO networking_nsxv3.common.synchronization [req-56f687fd-1766-47c5-b83b-b7d195d8db88 req-c4a8b4af-6d29-4749-b309-0c47805d3ea2 service nova] Enqueued Resource ID: 472bc109-47c4-4346-8abb-d08340fc85a8 with Priority: HIGHEST for action port [ 1035.998913] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_rules [ 1035.999054] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1035.999200] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 472bc109-47c4-4346-8abb-d08340fc85a8 with Priority: HIGHEST for action port [ 1036.000133] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.000243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.000454] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.000535] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.000721] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-472bc109-47c4-4346-8abb-d08340fc85a8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.000800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-472bc109-47c4-4346-8abb-d08340fc85a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.000890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-472bc109-47c4-4346-8abb-d08340fc85a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.001069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-472bc109-47c4-4346-8abb-d08340fc85a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.001150] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('472bc109-47c4-4346-8abb-d08340fc85a8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.028481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.028957] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.029126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.029199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.029415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.029499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.029601] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40420088-ac97-4318-add0-c3b84e42921a is going to be updated. [ 1036.031991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.031991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.056208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.056286] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.056376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.056515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.056636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.056703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.056764] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be updated. [ 1036.057910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.058123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.092043] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.092043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.092820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.093079] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.093166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.093229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.093436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.093510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.093591] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be updated. [ 1036.094610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.094783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.094919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.097731] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.097831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.097953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.098095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.098291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.112862] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40420088-ac97-4318-add0-c3b84e42921a in Status: IN_PROGRESS for 2s [ 1036.113559] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc470104-8593-4197-8a42-8965abae6489 in Status: IN_PROGRESS for 2s [ 1036.141421] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: SUCCESS [ 1036.141777] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.141818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.142023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.142223] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.142341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.142446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.142589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.142668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.142755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.142855] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.143899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.143983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.144823] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.144823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.144823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.144973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.145055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.145142] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.164590] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.164791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.164840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.165062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.165222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.183062] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: IN_PROGRESS for 2s [ 1036.184304] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.184429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.184560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.184803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.184950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.217494] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: IN_PROGRESS for 2s [ 1036.503533] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 472bc109-47c4-4346-8abb-d08340fc85a8 with status ACTIVE [ 1036.503890] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.504446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.504504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.504855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.504960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.505172] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.505288] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.505358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.505526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.505635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.505848] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.505955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.506018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.506168] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.506309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.506309] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 472bc109-47c4-4346-8abb-d08340fc85a8 is going to be updated. [ 1036.534138] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.534550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.534550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.534722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.534943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.535231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-472bc109-47c4-4346-8abb-d08340fc85a8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.647408] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.647408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.647670] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.909975] env[66364]: INFO networking_nsxv3.common.synchronization [req-b4f9979f-de6b-41ef-8c01-82aa311eefb6 req-297617c5-0446-4b57-a7e6-966acf4d3f58 tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1036.910795] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1036.911280] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.911460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.911618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.911950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.912185] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.912378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.912486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.912740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.912879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.913310] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.152590] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.238329] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.238532] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.238701] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.239255] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.239348] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.239468] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.239725] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.239824] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.239886] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.240169] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.240440] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.240553] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.240659] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.240772] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.240882] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.241021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.263013] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.263201] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.263339] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.263511] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.263943] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-2f0441b7-5292-49ff-9e06-2a849b6f051b taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.264089] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-2f0441b7-5292-49ff-9e06-2a849b6f051b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.264216] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-2f0441b7-5292-49ff-9e06-2a849b6f051b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.264434] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-2f0441b7-5292-49ff-9e06-2a849b6f051b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.264626] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f0441b7-5292-49ff-9e06-2a849b6f051b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.416101] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.416259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.416316] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.416496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.416583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.417141] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.417267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.417321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.417474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.417549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.417632] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be deleted. [ 1037.446498] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.446698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.446698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.446895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.446975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.447090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.657358] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.657696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.657696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.657862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.657965] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.658065] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 is going to be updated. [ 1037.688913] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.689025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.689101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.689309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.689457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.700391] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: IN_PROGRESS for 2s [ 1037.766613] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.766910] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.766910] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.767221] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.767371] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.767521] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 2f0441b7-5292-49ff-9e06-2a849b6f051b not found, creating... [ 1037.767771] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.767922] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.768049] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.768268] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.768401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.768670] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.768824] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.768937] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.769159] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.769291] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.769422] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 2f0441b7-5292-49ff-9e06-2a849b6f051b is going to be created. [ 1037.790783] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.790783] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.790783] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.791185] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.791282] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.791520] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-2f0441b7-5292-49ff-9e06-2a849b6f051b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.006173] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 665d57cc-5dea-494f-b1df-651330cfd64a in Status: SUCCESS [ 1038.006373] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 665d57cc-5dea-494f-b1df-651330cfd64a deletion is rescheduled due to dependency. [ 1038.006513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.128776] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc470104-8593-4197-8a42-8965abae6489 in Status: SUCCESS [ 1038.129032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.129757] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40420088-ac97-4318-add0-c3b84e42921a in Status: SUCCESS [ 1038.129964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.213213] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 1038.213446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.229992] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: SUCCESS [ 1038.230223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.522886] env[66364]: INFO networking_nsxv3.common.synchronization [req-b4f9979f-de6b-41ef-8c01-82aa311eefb6 req-ab7d126d-7f36-4409-90e2-1f429c2fe18d service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 1038.523203] env[66364]: INFO networking_nsxv3.common.synchronization [req-b4f9979f-de6b-41ef-8c01-82aa311eefb6 req-ab7d126d-7f36-4409-90e2-1f429c2fe18d service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1038.523319] env[66364]: INFO networking_nsxv3.common.synchronization [req-b4f9979f-de6b-41ef-8c01-82aa311eefb6 req-ab7d126d-7f36-4409-90e2-1f429c2fe18d service nova] Enqueued Resource ID: 2f0441b7-5292-49ff-9e06-2a849b6f051b with Priority: HIGHEST for action port [ 1038.523992] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 1038.524230] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1038.524352] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f0441b7-5292-49ff-9e06-2a849b6f051b with Priority: HIGHEST for action port [ 1038.524643] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.524783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.524864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.525080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.525163] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.526258] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.526412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.526412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.526608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.526769] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.526862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.526926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.527103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.527181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.527278] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.528194] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f0441b7-5292-49ff-9e06-2a849b6f051b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.528360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f0441b7-5292-49ff-9e06-2a849b6f051b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.528360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f0441b7-5292-49ff-9e06-2a849b6f051b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.529019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f0441b7-5292-49ff-9e06-2a849b6f051b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.529019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f0441b7-5292-49ff-9e06-2a849b6f051b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.031056] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.031429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.031753] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.032532] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f0441b7-5292-49ff-9e06-2a849b6f051b with status ACTIVE [ 1039.033442] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.033442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.033442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.033442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.033442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.033442] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.033774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.033774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.033774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.033901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.034480] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.034480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.034480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.034480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.034480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.034832] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f0441b7-5292-49ff-9e06-2a849b6f051b is going to be updated. [ 1039.057286] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.057467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.057553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.057851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.058053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.058272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f0441b7-5292-49ff-9e06-2a849b6f051b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.536524] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.711901] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: SUCCESS [ 1039.711901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.711901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.711901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.711901] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.711901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.711901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.711901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.711901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.711901] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.039592] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.039592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.039975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.039975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.040066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.040448] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be created. [ 1040.070282] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.070501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.070501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.070804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.071087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.081578] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: UNINITIALIZED for 2s [ 1040.214652] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.717233] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.219386] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.219717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.219717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.219815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.220155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.220155] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 is going to be updated. [ 1041.250101] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.250252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.250307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.250511] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.250684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.262191] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: IN_PROGRESS for 2s [ 1042.095442] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1042.095747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.095907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.096202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.096422] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.096640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.096716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.096901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.096976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.097066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.097160] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.599730] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.600065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.600065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.600193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.600356] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.600471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.600511] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.600657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.600743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.600833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.600976] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.601077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.601137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.601275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.601409] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.601498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.601558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.601694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.601765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.601844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.601932] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.104058] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b49ee1f8-75f0-4dc8-86a3-69683601a19d: rpc.has_security_group_logging(os_id): False [ 1043.125830] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.125982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.126069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.126263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.126349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.126558] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.126672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.126738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.127056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.127134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.127316] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.127407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.127459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.127594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.127669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.127855] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.127945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.127993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.128145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.128219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.128297] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be created. [ 1043.190205] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.190426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.190426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.190622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.190807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.208146] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1043.278083] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: SUCCESS [ 1043.278343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.278536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.278771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.279053] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.279223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.279306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.279557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.279644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.279746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.279916] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.280040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.280089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.280240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.280455] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.280574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.280640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.280787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.280870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.280956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.281045] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.525499] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1043.525775] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1043.783673] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7: rpc.has_security_group_logging(os_id): False [ 1043.803443] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.803670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.803772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.804086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.804223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.804595] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.804850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.804850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.805121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.805246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.805519] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.805684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.805763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.805920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.805999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.806321] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.806436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.806476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.806646] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.806726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.806863] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 is going to be created. [ 1043.867665] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.867855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.867905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.868150] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.868343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.881832] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: IN_PROGRESS for 2s [ 1044.056037] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-977 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.056394] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.056579] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.056898] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.057457] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.057617] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.057761] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.058009] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.058159] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.058370] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.058476] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.058588] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.058690] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.059248] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.059375] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.059514] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.081520] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.081793] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1044.081907] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.082045] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-977" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.082380] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.082612] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.082760] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.083041] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.083195] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd2b6e31-0bf7-48a7-9a73-7538be7fc48f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.585761] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.586073] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.586221] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.586503] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.586655] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.586981] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.587184] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.587303] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.587539] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.587690] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.588007] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.588191] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.588320] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.588557] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.588695] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.588913] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: dd2b6e31-0bf7-48a7-9a73-7538be7fc48f is going to be updated. [ 1044.615840] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.616160] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.616266] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.616479] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.616666] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.616882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.231608] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1045.231895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.364485] env[66364]: INFO networking_nsxv3.common.synchronization [req-d25d5a44-fa26-4b76-8b7d-f3c408bd716a req-13ef08a1-6ad3-49ef-8ed8-536e2820a07d service nova] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_rules [ 1045.364485] env[66364]: INFO networking_nsxv3.common.synchronization [req-d25d5a44-fa26-4b76-8b7d-f3c408bd716a req-13ef08a1-6ad3-49ef-8ed8-536e2820a07d service nova] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 1045.364485] env[66364]: INFO networking_nsxv3.common.synchronization [req-d25d5a44-fa26-4b76-8b7d-f3c408bd716a req-13ef08a1-6ad3-49ef-8ed8-536e2820a07d service nova] Enqueued Resource ID: dd2b6e31-0bf7-48a7-9a73-7538be7fc48f with Priority: HIGHEST for action port [ 1045.364485] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_rules [ 1045.364731] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 1045.364731] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd2b6e31-0bf7-48a7-9a73-7538be7fc48f with Priority: HIGHEST for action port [ 1045.365297] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.365485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.365543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.365773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.365883] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.366803] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.367049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.367140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.367560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.367747] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.368361] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.368455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.368632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.370418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.370418] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.370418] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.370418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.370418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.370418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.370418] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd2b6e31-0bf7-48a7-9a73-7538be7fc48f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.871444] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.872459] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.872607] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.875075] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd2b6e31-0bf7-48a7-9a73-7538be7fc48f with status ACTIVE [ 1045.875255] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.875367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.875430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.875703] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.875804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.875979] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.876090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.876150] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.876308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.876383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.876560] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.876742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.876840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.877545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.877545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.877545] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd2b6e31-0bf7-48a7-9a73-7538be7fc48f is going to be updated. [ 1045.894392] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: SUCCESS [ 1045.894637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.894803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.895015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.895106] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.900787] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.900948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.900998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.901178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.901311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.901461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd2b6e31-0bf7-48a7-9a73-7538be7fc48f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.373891] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.397382] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.397382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.397382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.397382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.397382] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.397687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.397687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.397687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.397790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.397835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.398021] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.878402] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.878939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.879603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.879603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.879603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.879603] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be updated. [ 1046.900877] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.901548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.901548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.901548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.901548] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.901787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.901787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.901894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.901963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.902061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.902228] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.902319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.902389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.902548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.902695] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.902807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.902867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.903029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.903112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.903175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.903266] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.908746] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.908886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.908950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.909222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.909284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.919674] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: IN_PROGRESS for 2s [ 1047.147699] env[66364]: INFO networking_nsxv3.common.synchronization [req-abeab61c-519d-48ae-912b-f12b71f4c8b2 req-c121997f-28c2-4b84-9d31-5614650ec64d tempest-ListImageFiltersTestJSON-1648004635 tempest-ListImageFiltersTestJSON-1648004635-project-member] Enqueued Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1047.147954] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1047.148562] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.148769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.148875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.149093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.149267] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.149480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.149480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.149648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.149740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.149784] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.406970] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7: rpc.has_security_group_logging(os_id): False [ 1047.427701] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.427701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.427701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.427701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.428022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.428456] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.430313] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.430313] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.430313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.430853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.430853] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 is going to be updated. [ 1047.507102] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.507102] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.507102] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.507102] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.507102] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.507102] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.507102] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.507791] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.508111] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.508457] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.508687] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.508926] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.509176] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.509444] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.509867] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.510248] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.523158] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.523396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.523396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.523658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.523785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.534775] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.535039] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1047.535203] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.535275] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.535606] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-e564cf6a-606d-4c8e-a0aa-e4165ecff781 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.535883] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-e564cf6a-606d-4c8e-a0aa-e4165ecff781" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.535981] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-e564cf6a-606d-4c8e-a0aa-e4165ecff781" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.536446] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-e564cf6a-606d-4c8e-a0aa-e4165ecff781" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.536565] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e564cf6a-606d-4c8e-a0aa-e4165ecff781',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.541880] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: IN_PROGRESS for 2s [ 1047.652166] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.652790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.652790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.652790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.652999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.653211] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.653395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.653451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.653648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.653759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.653870] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ad2de4-2360-481d-804e-9be48864280c already deleted. [ 1047.653980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.039497] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.039497] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.039497] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.040292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.040292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.040292] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port e564cf6a-606d-4c8e-a0aa-e4165ecff781 not found, creating... [ 1048.040292] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.040468] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.040562] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.040840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.040978] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.041278] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.041449] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.041563] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.041769] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.041901] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.042111] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: e564cf6a-606d-4c8e-a0aa-e4165ecff781 is going to be created. [ 1048.063989] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.064246] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.064373] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.064714] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.064955] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.065221] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-e564cf6a-606d-4c8e-a0aa-e4165ecff781" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.846094] env[66364]: INFO networking_nsxv3.common.synchronization [req-abeab61c-519d-48ae-912b-f12b71f4c8b2 req-1e9a0494-f4ca-4f90-babf-8a878d4051c1 service nova] Enqueued Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_rules [ 1048.846649] env[66364]: INFO networking_nsxv3.common.synchronization [req-abeab61c-519d-48ae-912b-f12b71f4c8b2 req-1e9a0494-f4ca-4f90-babf-8a878d4051c1 service nova] Enqueued Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1048.846649] env[66364]: INFO networking_nsxv3.common.synchronization [req-abeab61c-519d-48ae-912b-f12b71f4c8b2 req-1e9a0494-f4ca-4f90-babf-8a878d4051c1 service nova] Enqueued Resource ID: e564cf6a-606d-4c8e-a0aa-e4165ecff781 with Priority: HIGHEST for action port [ 1048.847758] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_rules [ 1048.847758] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1048.847941] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e564cf6a-606d-4c8e-a0aa-e4165ecff781 with Priority: HIGHEST for action port [ 1048.848212] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.848442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.848531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.848816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.848968] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.849945] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.850975] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.851065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.851277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.851433] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.851533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.851595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.851953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.851953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.851953] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.852908] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e564cf6a-606d-4c8e-a0aa-e4165ecff781 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.853134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e564cf6a-606d-4c8e-a0aa-e4165ecff781" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.853204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e564cf6a-606d-4c8e-a0aa-e4165ecff781" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.854142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e564cf6a-606d-4c8e-a0aa-e4165ecff781" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.854328] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e564cf6a-606d-4c8e-a0aa-e4165ecff781',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.931073] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: SUCCESS [ 1048.931368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.931483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.931714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.931906] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.932024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.932110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.932255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.932926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.932926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.932926] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.357575] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.357786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.358070] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.359575] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e564cf6a-606d-4c8e-a0aa-e4165ecff781 with status ACTIVE [ 1049.359786] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.359926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.360020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.360273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.360394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.360606] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.360742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.361334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.361334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.361334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.361334] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.361334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.362042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.362042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.362042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.362042] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e564cf6a-606d-4c8e-a0aa-e4165ecff781 is going to be updated. [ 1049.384091] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.384261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.384306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.384501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.384665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.384808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e564cf6a-606d-4c8e-a0aa-e4165ecff781" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.434532] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.434730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.434782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.434976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.435153] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.435305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.435305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.435449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.435532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.435637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.435792] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.435893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.435943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.436130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.436270] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.436351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.436412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.436546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.436866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.436866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.436866] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.557980] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: SUCCESS [ 1049.558230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.863680] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.942380] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d32f784a-4b9d-4ad9-8cac-3dcf099fea9c: rpc.has_security_group_logging(os_id): False [ 1049.962035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.962035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.962271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.962342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.962380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.963144] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.963144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.963144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.963144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.963622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.963833] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.963987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.963987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.964233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.964720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.964720] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.964720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.964720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.964915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.964915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.964997] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be created. [ 1050.028800] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.029036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.029147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.029463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.029737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.057530] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: IN_PROGRESS for 2s [ 1050.368661] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.368869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.368937] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.369177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.369335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.369335] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ad2de4-2360-481d-804e-9be48864280c is going to be created. [ 1050.404569] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.405320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.405320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.405320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.405320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.416563] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: UNINITIALIZED for 2s [ 1051.935317] env[66364]: INFO networking_nsxv3.common.synchronization [req-fad6be89-7fe0-485c-9015-c9cd2a4a1b16 req-6dd07037-fd79-4775-bc9e-7e9bbb84b9cb tempest-ListImageFiltersTestJSON-1648004635 tempest-ListImageFiltersTestJSON-1648004635-project-member] Enqueued Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1051.935317] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1051.935681] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.935830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.074494] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: SUCCESS [ 1052.074815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.299255] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-313 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.299255] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.299255] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.299582] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.300020] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.300255] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.300377] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.300697] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.300903] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.301276] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.301490] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.301556] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.301723] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.301723] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.301826] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.301960] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.324346] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.324515] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.324750] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.324942] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-313" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.325446] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.325676] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.325899] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.326325] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.326416] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.427075] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: SUCCESS [ 1052.427308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.427474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.427705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.427901] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.428029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.428094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.428252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.428331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.428416] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.428516] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.429477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.429646] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.429808] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.429909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.429985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.430225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.430309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.430397] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.829623] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.829877] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.830015] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.830330] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.830483] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.830642] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9 not found, creating... [ 1052.830925] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.831099] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.831241] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.831452] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.831587] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.831878] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.832045] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.832160] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.832371] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.832548] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.832755] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9 is going to be created. [ 1052.873706] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.873706] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.874091] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.875086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.875086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.875086] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.932680] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.932996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.933227] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.436705] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.662504] env[66364]: INFO networking_nsxv3.common.synchronization [req-fad6be89-7fe0-485c-9015-c9cd2a4a1b16 req-c41b5b0c-741f-49b1-abd7-13fafefd7288 service nova] Enqueued Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_rules [ 1053.662790] env[66364]: INFO networking_nsxv3.common.synchronization [req-fad6be89-7fe0-485c-9015-c9cd2a4a1b16 req-c41b5b0c-741f-49b1-abd7-13fafefd7288 service nova] Enqueued Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1053.663060] env[66364]: INFO networking_nsxv3.common.synchronization [req-fad6be89-7fe0-485c-9015-c9cd2a4a1b16 req-c41b5b0c-741f-49b1-abd7-13fafefd7288 service nova] Enqueued Resource ID: 1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9 with Priority: HIGHEST for action port [ 1053.663963] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_rules [ 1053.664045] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1053.664379] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9 with Priority: HIGHEST for action port [ 1053.664533] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.664772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.665042] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.665174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.665441] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.665670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.665999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.666577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.666816] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.939313] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.939499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.939630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.939886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.940023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.940139] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ad2de4-2360-481d-804e-9be48864280c is going to be updated. [ 1053.976387] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.976387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.976387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.976387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.976891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.988070] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: IN_PROGRESS for 2s [ 1054.170605] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9 with status ACTIVE [ 1054.170605] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.171042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.171042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.171148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.171212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.171648] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.171648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.171797] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.171916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.171983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.172147] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.172886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.172886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.172886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.172886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.172886] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9 is going to be updated. [ 1054.208696] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.208935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.208935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.209268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.209460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.209636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f8e3b0e-cb0c-413f-abd7-c3db3dfd40e9" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.322017] env[66364]: INFO networking_nsxv3.common.synchronization [req-762994a7-f5fe-4be2-b6c0-7f5b52a7c70d req-1847e03f-cb54-4d5a-9bac-1fe1823e3ced tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1054.322673] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1054.326215] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.326215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.326215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.326215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.326215] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.326215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.326215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.326215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.326215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.326215] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.762503] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.763562] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.763562] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.763653] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.764060] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.764323] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.764513] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.764921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.765170] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.765500] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.765694] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.765882] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.766091] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.766310] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.767566] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.767566] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.796169] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.796497] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1054.796747] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.797079] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.797556] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.797829] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.798050] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.798517] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.798763] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fb4cbd3-2729-48db-9844-9dd27e7bf1fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.828413] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.828653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.828790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.829107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.851324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.851600] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.851750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.851817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.852034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.852129] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.852208] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1054.881017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.881266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.881370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.881682] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.881898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.903071] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1055.301779] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.302160] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.302358] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.302841] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.303106] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.303345] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 5fb4cbd3-2729-48db-9844-9dd27e7bf1fd not found, creating... [ 1055.303824] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.304262] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.304484] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.304871] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.305125] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.305693] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.305947] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.306091] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.306471] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.306783] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.307062] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 5fb4cbd3-2729-48db-9844-9dd27e7bf1fd is going to be created. [ 1055.335833] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.336211] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.336438] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.337101] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.337497] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.337898] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.000923] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: SUCCESS [ 1056.000923] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.001414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.001414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.001622] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.001755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.001833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.001992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.002097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.002224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.002472] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.002676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.002792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.003388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.004047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.004201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.004272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.004469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.004572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.004758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.004881] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.006073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.006204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.006347] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.006608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.006691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.006995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.007193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.007354] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.125821] env[66364]: INFO networking_nsxv3.common.synchronization [req-762994a7-f5fe-4be2-b6c0-7f5b52a7c70d req-69b09877-faaf-4039-9e13-4cf6e51d4c56 service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 1056.129731] env[66364]: INFO networking_nsxv3.common.synchronization [req-762994a7-f5fe-4be2-b6c0-7f5b52a7c70d req-69b09877-faaf-4039-9e13-4cf6e51d4c56 service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1056.130172] env[66364]: INFO networking_nsxv3.common.synchronization [req-762994a7-f5fe-4be2-b6c0-7f5b52a7c70d req-69b09877-faaf-4039-9e13-4cf6e51d4c56 service nova] Enqueued Resource ID: 5fb4cbd3-2729-48db-9844-9dd27e7bf1fd with Priority: HIGHEST for action port [ 1056.130809] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 1056.131030] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1056.131266] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb4cbd3-2729-48db-9844-9dd27e7bf1fd with Priority: HIGHEST for action port [ 1056.131625] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.131802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.131901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.132095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.132305] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.133502] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.133502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.133886] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.134071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.134164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.134383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.134466] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fb4cbd3-2729-48db-9844-9dd27e7bf1fd',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.509166] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0ad2de4-2360-481d-804e-9be48864280c: rpc.has_security_group_logging(os_id): False [ 1056.511895] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.536678] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.536932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.536932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.537301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.537760] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.539980] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.539980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.539980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.539980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.539980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.540308] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.542602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.542602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.542602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.542788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.543019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.543145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.543660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.543660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.543660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.543660] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ad2de4-2360-481d-804e-9be48864280c is going to be created. [ 1056.635968] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.635968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.635968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.635968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.636298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.637413] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.637674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.637674] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fb4cbd3-2729-48db-9844-9dd27e7bf1fd with status ACTIVE [ 1056.638122] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.638122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.638122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.639352] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.639352] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.639352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.639881] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fb4cbd3-2729-48db-9844-9dd27e7bf1fd is going to be updated. [ 1056.659173] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: IN_PROGRESS for 2s [ 1056.671861] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.671861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.671861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.671861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.671861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.671861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fb4cbd3-2729-48db-9844-9dd27e7bf1fd" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.922051] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1056.922051] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 1056.922051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.922051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.922051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.922051] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.922051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.922051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.922051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.922051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.922051] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.015038] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.434204] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.518449] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.518449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.518449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.518449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.518449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.518449] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ad2de4-2360-481d-804e-9be48864280c is going to be updated. [ 1057.559189] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.562020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.562020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.562020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.562020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.577624] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: IN_PROGRESS for 2s [ 1057.936754] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.442501] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.443204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.443204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.444627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.444627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.444627] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1058.480228] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.480444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.480727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.480846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.481067] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.493175] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1058.675798] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: SUCCESS [ 1058.676121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.676366] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.677030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.677030] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.179537] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.179537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.590795] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: SUCCESS [ 1059.591161] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.591511] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.591823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.592223] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.592223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.592336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.592736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.592736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.593178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.593178] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.096057] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.096057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.096254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.096392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.096608] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.096825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.096882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.097047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.097139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.097229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.097428] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.097539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.097539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.097742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.097878] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.097967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.098042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.098190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.098264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.098345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.098431] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.504806] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1060.504806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.504806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.504946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.505100] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.505212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.505271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.505433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.506603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.506603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.506603] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.601474] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0ad2de4-2360-481d-804e-9be48864280c: rpc.has_security_group_logging(os_id): False [ 1060.624510] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.624510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.624510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.624510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.624510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.624510] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.624510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.624510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.625303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.625575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.626042] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.626855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.626855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.627420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.627696] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.629199] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.629199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.629199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.629199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.629199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.629199] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0ad2de4-2360-481d-804e-9be48864280c is going to be updated. [ 1060.713423] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.713614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.713698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.713915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.714079] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.731182] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: IN_PROGRESS for 2s [ 1061.009635] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.009812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.009812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.010038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.010154] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.010502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.010502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.010644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.010644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.011143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.011276] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.011391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.011464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.011825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.011825] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.011967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.011967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.012103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.012263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.012336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.013380] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.133099] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1061.133099] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1061.515550] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e327b378-51f2-4bc5-8b1c-697b0302c4a5: rpc.has_security_group_logging(os_id): False [ 1061.545731] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.545911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.545987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.547639] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.547639] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.547639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.548427] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.548427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.548427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.548427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.548427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.548427] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1061.647461] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.648181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.648181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.648181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.648181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.675774] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1062.747548] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: SUCCESS [ 1062.748063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.697943] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1063.697943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.385347] env[66364]: INFO networking_nsxv3.common.synchronization [req-27dc9f8c-839d-4f94-a5a0-6c08ce103b22 req-685b7892-19d9-490c-a439-1827c7840b79 tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1065.386951] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1065.386951] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.386951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.386951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.386951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.387433] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.387433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.387523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.387654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.387837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.387983] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.890621] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.890837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.890957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.891252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.891966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.892256] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.892418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.892497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.892772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.892869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.892949] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1065.929365] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.929586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.929586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.929947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.929947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.941550] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1067.954829] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1067.955178] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d deletion is rescheduled due to dependency. [ 1067.955235] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.778311] env[66364]: INFO networking_nsxv3.common.synchronization [req-b173ed70-bb44-414a-81f5-f3b971949a1e req-86e0bf6b-41d2-4846-9758-6debef638440 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 1069.778977] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 1069.779530] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.779654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.779714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.779992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.780341] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.780341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.780535] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.780611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.780731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.780851] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.152156] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-319 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.152352] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.152499] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.152867] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.153262] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.153485] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.153638] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.155135] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.155382] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.155693] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.155862] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.155988] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.156170] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.156312] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.156419] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.156589] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.180387] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.180595] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1070.180746] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.180965] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.181310] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-e6347796-6251-486d-a4d0-a4588b154f8a taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.181512] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.181662] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.182032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.182192] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6347796-6251-486d-a4d0-a4588b154f8a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.283112] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.283415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.283415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.283622] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.283700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.283908] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.284010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.284073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.284245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.284358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.284412] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c000df34-07b2-4015-b824-73615ee8d750 is going to be deleted. [ 1070.464974] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.465197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.465197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.465387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.465515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.465637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.686486] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.686486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.686486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.686486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.686486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.686486] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port e6347796-6251-486d-a4d0-a4588b154f8a not found, creating... [ 1070.686486] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.686486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.686486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.686486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.687240] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.687240] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.687240] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.687240] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.687437] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.687549] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.687694] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: e6347796-6251-486d-a4d0-a4588b154f8a is going to be created. [ 1070.711243] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.711532] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.711666] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.712821] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.712821] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.712821] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.470981] env[66364]: INFO networking_nsxv3.common.synchronization [req-b173ed70-bb44-414a-81f5-f3b971949a1e req-01df0628-6ca3-46d8-b0f4-0d12dc9760c1 service nova] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_rules [ 1071.471322] env[66364]: INFO networking_nsxv3.common.synchronization [req-b173ed70-bb44-414a-81f5-f3b971949a1e req-01df0628-6ca3-46d8-b0f4-0d12dc9760c1 service nova] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 1071.471322] env[66364]: INFO networking_nsxv3.common.synchronization [req-b173ed70-bb44-414a-81f5-f3b971949a1e req-01df0628-6ca3-46d8-b0f4-0d12dc9760c1 service nova] Enqueued Resource ID: e6347796-6251-486d-a4d0-a4588b154f8a with Priority: HIGHEST for action port [ 1071.471835] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_rules [ 1071.471972] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 1071.472241] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6347796-6251-486d-a4d0-a4588b154f8a with Priority: HIGHEST for action port [ 1071.472540] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.472667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.472732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.472946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.473105] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.474375] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.474604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.474691] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.475764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.475764] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.475764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.475764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.475764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.475764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.475764] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.477700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6347796-6251-486d-a4d0-a4588b154f8a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.477700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.477700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.477700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.477700] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6347796-6251-486d-a4d0-a4588b154f8a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.975595] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.975595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.982324] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.982324] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6347796-6251-486d-a4d0-a4588b154f8a with status ACTIVE [ 1071.982324] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.982324] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.982324] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.982324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.983034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.983034] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6347796-6251-486d-a4d0-a4588b154f8a is going to be updated. [ 1072.007185] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.007509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.007509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.007727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.007875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.008077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.376588] env[66364]: INFO networking_nsxv3.common.synchronization [req-c5dce189-14c4-4dab-9446-3a7080a63991 req-98ae91f2-a660-47ff-a3f3-0f9c62472671 tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1072.382193] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1072.382657] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.382817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.382911] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.383203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.383397] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.383540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.383742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.383851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.384018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.384164] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.486309] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.858777] env[66364]: INFO networking_nsxv3.common.synchronization [req-a985cc6a-29b3-4aca-a7c4-1781e3947d82 req-e2b97ff2-35a2-40cd-9bf1-0a940553fd1f tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1072.859646] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1072.860010] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.860426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.860502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.861087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.861087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.861087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.861295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.861295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.861370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.861475] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.889640] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.890130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.890130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.890260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.890260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.890469] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.890575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.890644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.890815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.890895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.890985] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1072.960209] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.960396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.960451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.960649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.961015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.978036] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1072.989648] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.989854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.989956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.990257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.990408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.990531] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c000df34-07b2-4015-b824-73615ee8d750 is going to be created. [ 1073.018339] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.018502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.018577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.018807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.018960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.031183] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: UNINITIALIZED for 2s [ 1073.282774] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.282774] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.282774] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.284240] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.284240] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.284240] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.284240] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.284603] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.284603] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.284752] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.284916] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.285057] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.285162] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.288256] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.288256] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.288256] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.322953] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.322953] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.322953] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.322953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.322953] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-32e3c86c-d354-40b1-b305-008beee14156 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.322953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-32e3c86c-d354-40b1-b305-008beee14156" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.322953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-32e3c86c-d354-40b1-b305-008beee14156" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.323426] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-32e3c86c-d354-40b1-b305-008beee14156" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.323426] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e3c86c-d354-40b1-b305-008beee14156',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.362042] env[66364]: INFO networking_nsxv3.common.synchronization [req-c2702cdd-a580-4662-a810-d4432f6ed123 req-32e20abb-1ff1-4910-b417-f9db4e08e5ac tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1073.362042] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1073.362514] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.366072] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.366072] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.366072] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.366072] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.366072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.367013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.367013] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.367013] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be deleted. [ 1073.402071] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.402071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.402071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.402071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.402071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.402071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.826183] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.826672] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.826672] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.826821] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.827019] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.827201] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 32e3c86c-d354-40b1-b305-008beee14156 not found, creating... [ 1073.827481] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.827647] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.827756] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.828016] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.828162] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.828451] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.828603] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.828729] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.828929] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.829077] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.829215] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 32e3c86c-d354-40b1-b305-008beee14156 is going to be created. [ 1073.862370] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.862674] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.862968] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.863418] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.863848] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.864870] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-32e3c86c-d354-40b1-b305-008beee14156" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.869034] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.869034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.869034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.869237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.869333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.869642] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.869752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.870112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.870112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.870239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.870386] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1073.873148] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.873323] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.873408] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.873757] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.874155] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.874580] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.874580] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.874897] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.875107] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.875530] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.875721] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.875920] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.876114] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.876298] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.876494] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.876682] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.899093] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.899390] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.899390] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.899623] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.900097] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-bf3b9240-088c-468b-ae8a-99058a39f095 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.900349] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-bf3b9240-088c-468b-ae8a-99058a39f095" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.900563] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-bf3b9240-088c-468b-ae8a-99058a39f095" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.900973] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-bf3b9240-088c-468b-ae8a-99058a39f095" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.901178] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf3b9240-088c-468b-ae8a-99058a39f095',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.919530] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.919712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.919875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.920160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.920292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.932443] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1074.404532] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.404743] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.404953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.405301] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.405525] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.405957] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port bf3b9240-088c-468b-ae8a-99058a39f095 not found, creating... [ 1074.406460] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.406748] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.406905] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.407201] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.407349] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.407723] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.407898] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.408028] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.408274] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.408415] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.408590] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: bf3b9240-088c-468b-ae8a-99058a39f095 is going to be created. [ 1074.436317] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.436624] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.436699] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.436976] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.437315] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.437751] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-bf3b9240-088c-468b-ae8a-99058a39f095" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.604425] env[66364]: INFO networking_nsxv3.common.synchronization [req-a985cc6a-29b3-4aca-a7c4-1781e3947d82 req-37885508-ba91-4684-acd0-3d2921adffe8 service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 1074.604640] env[66364]: INFO networking_nsxv3.common.synchronization [req-a985cc6a-29b3-4aca-a7c4-1781e3947d82 req-37885508-ba91-4684-acd0-3d2921adffe8 service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1074.604843] env[66364]: INFO networking_nsxv3.common.synchronization [req-a985cc6a-29b3-4aca-a7c4-1781e3947d82 req-37885508-ba91-4684-acd0-3d2921adffe8 service nova] Enqueued Resource ID: 32e3c86c-d354-40b1-b305-008beee14156 with Priority: HIGHEST for action port [ 1074.605479] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 1074.608028] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1074.608028] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e3c86c-d354-40b1-b305-008beee14156 with Priority: HIGHEST for action port [ 1074.608028] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.608028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.608028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.608028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.608028] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.609916] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.609916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.609916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.609916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.610069] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.610140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.610232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.610397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.610509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.610614] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.613486] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-32e3c86c-d354-40b1-b305-008beee14156 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.613608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32e3c86c-d354-40b1-b305-008beee14156" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.613665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32e3c86c-d354-40b1-b305-008beee14156" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.616170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32e3c86c-d354-40b1-b305-008beee14156" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.616170] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e3c86c-d354-40b1-b305-008beee14156',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.988034] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1074.988345] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 1074.988380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.012286] env[66364]: INFO networking_nsxv3.common.synchronization [req-cde41242-e0fb-4a20-8fb0-c0d2adad8693 req-e08692af-577f-4cd8-af2a-3ac8ab975a5b tempest-ServerActionsTestOtherB-1668111998 tempest-ServerActionsTestOtherB-1668111998-project-member] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1075.014357] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1075.014870] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.014870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.015048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.015284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.015590] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.015709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.015863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.016069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.016213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.016359] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.040404] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: SUCCESS [ 1075.040671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.040875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.041109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.041295] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.041411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.041475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.041629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.041710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.041793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.041881] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.115164] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.121355] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.121355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.121355] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32e3c86c-d354-40b1-b305-008beee14156 with status ACTIVE [ 1075.121355] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.121355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.121355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.121355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.121355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.121355] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.121355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.121355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.121355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.121355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.121355] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.121752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.121752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.121752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.121752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.121752] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32e3c86c-d354-40b1-b305-008beee14156 is going to be updated. [ 1075.126269] env[66364]: INFO networking_nsxv3.common.synchronization [req-c2702cdd-a580-4662-a810-d4432f6ed123 req-94aa7598-f3fc-4089-bfa6-78e9d6dd03e4 service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 1075.126641] env[66364]: INFO networking_nsxv3.common.synchronization [req-c2702cdd-a580-4662-a810-d4432f6ed123 req-94aa7598-f3fc-4089-bfa6-78e9d6dd03e4 service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1075.126791] env[66364]: INFO networking_nsxv3.common.synchronization [req-c2702cdd-a580-4662-a810-d4432f6ed123 req-94aa7598-f3fc-4089-bfa6-78e9d6dd03e4 service nova] Enqueued Resource ID: bf3b9240-088c-468b-ae8a-99058a39f095 with Priority: HIGHEST for action port [ 1075.128219] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 1075.128437] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1075.128549] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf3b9240-088c-468b-ae8a-99058a39f095 with Priority: HIGHEST for action port [ 1075.129238] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.130036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.130036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.130036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.130036] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.131950] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.133255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.133976] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf3b9240-088c-468b-ae8a-99058a39f095 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.133976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf3b9240-088c-468b-ae8a-99058a39f095" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.133976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf3b9240-088c-468b-ae8a-99058a39f095" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.134183] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf3b9240-088c-468b-ae8a-99058a39f095" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.134183] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf3b9240-088c-468b-ae8a-99058a39f095',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.148646] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.148771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.148854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.149115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.149252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.149429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32e3c86c-d354-40b1-b305-008beee14156" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.518874] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.518874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.518874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.519179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.541829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.542277] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.542413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.542480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.542718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.542837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.542968] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1075.544239] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.544404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.544487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.544729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.544962] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.545117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.545187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.546032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.546032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.546032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.546032] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.546032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.546032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.547723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.547723] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.547723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.547723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.547723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.547723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.547723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.547723] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.585045] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.585315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.585315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.585524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.585838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.596977] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1075.618400] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.639910] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf3b9240-088c-468b-ae8a-99058a39f095 with status ACTIVE [ 1075.639910] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.639910] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.639910] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.639910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.639910] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf3b9240-088c-468b-ae8a-99058a39f095 is going to be updated. [ 1075.640801] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.641553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.666693] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.666850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.666967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.667300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.667507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.667701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf3b9240-088c-468b-ae8a-99058a39f095" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.947824] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1075.947824] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d deletion is rescheduled due to dependency. [ 1075.947824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.947824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.947824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.947824] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.947824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.947824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.947824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.947824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.947824] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.049411] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c000df34-07b2-4015-b824-73615ee8d750: rpc.has_security_group_logging(os_id): False [ 1076.072521] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.072521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.072521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.072805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.072805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.073909] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.073909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.073909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.073909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.073909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.073909] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.073909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.073909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.073909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.074298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.074398] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.074498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.074888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.074888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.074888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.075124] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c000df34-07b2-4015-b824-73615ee8d750 is going to be created. [ 1076.123713] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.123713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.123713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.123713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.123713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.123713] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be created. [ 1076.152726] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.153453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.153453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.153453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.153624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.156299] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.157113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.157113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.157113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.157255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.172246] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: UNINITIALIZED for 2s [ 1076.173230] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: IN_PROGRESS for 2s [ 1076.452111] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.955072] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.459049] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.459049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.459049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.459049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.459049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.459049] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1077.514173] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.514324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.514404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.514663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.515736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.532283] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1077.609477] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1077.609670] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 deletion is rescheduled due to dependency. [ 1077.609784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.184677] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1078.184994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.185339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.185604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.186061] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.186061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.186061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.186268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.186350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.186439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.186533] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.188075] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: SUCCESS [ 1078.188258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.689833] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.690370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.690370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.690573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.690826] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.691112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.691241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.691530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.691697] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.691920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.692255] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.692595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.692755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.693082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.693359] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.693544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.693662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.693905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.694048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.694245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.694401] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.730901] env[66364]: INFO networking_nsxv3.common.synchronization [req-2b5d1728-017e-4e79-b044-4c49de4508c5 req-da9afd41-9f5e-44ff-aee1-a21e9819d611 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_members [ 1078.731700] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGHEST for action security_group_members [ 1078.732302] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.732302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.732403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.732609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.732859] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.732997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.733098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.733321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.733629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.733629] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.197233] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 622b5ca5-0010-4122-b9d4-901a52d1aa5c: rpc.has_security_group_logging(os_id): False [ 1079.219315] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.219917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.219917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.219917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.219917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.220162] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.220292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.220360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.220574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.220669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.220919] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.221103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.221191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.221400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.221479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.221772] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.221884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.221949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.222128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.222221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.222332] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be created. [ 1079.240076] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.240076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.240076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.240076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.240266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.240449] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.240561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.240635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.240830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.240912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.241031] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc470104-8593-4197-8a42-8965abae6489 is going to be updated. [ 1079.300100] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.300100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.300100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.300100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.300100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.311490] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc470104-8593-4197-8a42-8965abae6489 in Status: IN_PROGRESS for 2s [ 1079.327425] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.327662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.327662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.327972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.328132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.369740] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1079.546267] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1079.547395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.548283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.548631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.548959] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.549144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.549209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.549398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.549491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.550019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.550019] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.764618] env[66364]: INFO networking_nsxv3.common.synchronization [None req-ac292b69-07cf-4e30-937d-9155ab413025 tempest-ServerRescueNegativeTestJSON-1330136755 tempest-ServerRescueNegativeTestJSON-1330136755-project-member] Enqueued Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_rules [ 1079.764832] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_rules [ 1079.765377] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df43df14-5db4-47e2-aec2-171f912259af taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.765503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.765572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.765856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.765961] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.865210] env[66364]: INFO networking_nsxv3.common.synchronization [None req-e53f114f-7548-4541-b19f-228854eae6c4 tempest-ServerRescueNegativeTestJSON-1330136755 tempest-ServerRescueNegativeTestJSON-1330136755-project-member] Enqueued Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_rules [ 1079.865876] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_rules [ 1079.866296] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df43df14-5db4-47e2-aec2-171f912259af taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.866411] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.052486] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.052687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.052809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.053157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.053478] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.053630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.053725] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.053955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.054099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.054403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.054496] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.054569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.054644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.055895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.055895] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.055895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.055895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.055895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.055895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.055895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.055895] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.310424] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.310638] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.310692] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.311018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.311165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.311329] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df43df14-5db4-47e2-aec2-171f912259af already deleted. [ 1080.311497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.311730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.312009] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.312158] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.558367] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b49ee1f8-75f0-4dc8-86a3-69683601a19d: rpc.has_security_group_logging(os_id): False [ 1080.579630] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.579988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.580066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.580274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.580373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.580624] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.580730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.580829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.581046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.581146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.581547] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.581659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.581727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.585019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.585019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.585019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.585019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.585019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.585019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.585019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.585019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1080.671522] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.671711] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.671816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.672110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.672274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.694773] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1080.835854] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.835854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.835854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.835854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.835854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.835854] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df43df14-5db4-47e2-aec2-171f912259af already deleted. [ 1080.835854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.067233] env[66364]: INFO networking_nsxv3.common.synchronization [None req-9bb4b22e-f4f3-4418-8904-f27b3e34b50e tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1081.067430] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1081.067725] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.067850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.067927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.068629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.068850] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.068932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.069037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.069159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.069279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.069564] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.324095] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc470104-8593-4197-8a42-8965abae6489 in Status: SUCCESS [ 1081.324334] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc470104-8593-4197-8a42-8965abae6489 deletion is rescheduled due to dependency. [ 1081.324453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.383909] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1081.383909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.572346] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.806607] env[66364]: INFO networking_nsxv3.common.synchronization [req-76a9f9ca-eb82-4542-8e14-1a7123508f7c req-a7e07800-a04e-4b32-a475-557abc6ab556 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 1081.807189] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGHEST for action security_group_members [ 1081.807488] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.807566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.807843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.807843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.807975] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.808163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.808163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.808292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.808378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.808467] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.866024] env[66364]: INFO networking_nsxv3.common.synchronization [req-76a9f9ca-eb82-4542-8e14-1a7123508f7c req-a7e07800-a04e-4b32-a475-557abc6ab556 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: e6347796-6251-486d-a4d0-a4588b154f8a with Priority: HIGHEST for action port [ 1081.866024] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6347796-6251-486d-a4d0-a4588b154f8a with Priority: HIGHEST for action port [ 1081.867028] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6347796-6251-486d-a4d0-a4588b154f8a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.867028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.867028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.868591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.868591] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6347796-6251-486d-a4d0-a4588b154f8a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.075685] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.310970] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.311181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.311232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.311456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.311544] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.311747] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.311847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.311908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.312124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.312356] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.312356] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c000df34-07b2-4015-b824-73615ee8d750 is going to be updated. [ 1082.347570] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.347570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.347570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.347838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.348310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.361482] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: IN_PROGRESS for 2s [ 1082.370291] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6347796-6251-486d-a4d0-a4588b154f8a with status ACTIVE [ 1082.370464] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.370464] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.370609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.370799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.370902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.371183] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.371321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.371380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.371571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.371662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.371863] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.371966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.372036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.372223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.372298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.372389] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6347796-6251-486d-a4d0-a4588b154f8a is going to be updated. [ 1082.394615] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.394794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.395570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.395570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.395570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.395570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6347796-6251-486d-a4d0-a4588b154f8a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.577464] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.577635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.577708] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.577929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.578036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.578147] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1082.607754] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.607914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.608015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.608269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.608829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.619914] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1082.709972] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1082.710225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.734076] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.734479] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.734479] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.734718] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.736012] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.736241] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.736372] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.736627] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.736789] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.737015] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.737148] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.737260] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.737367] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.737494] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.737604] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.737763] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.761687] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.761879] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1083.762037] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.762223] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.762585] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-28226e21-2062-44e4-8d0e-b8f214eeda26 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.762788] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-28226e21-2062-44e4-8d0e-b8f214eeda26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.762910] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-28226e21-2062-44e4-8d0e-b8f214eeda26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.763284] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-28226e21-2062-44e4-8d0e-b8f214eeda26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.763443] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28226e21-2062-44e4-8d0e-b8f214eeda26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.266377] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.266644] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.266825] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.267413] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.267683] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.267909] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 28226e21-2062-44e4-8d0e-b8f214eeda26 not found, creating... [ 1084.268394] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.268580] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.268703] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.268959] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.269244] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.269637] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.269820] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.269963] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.270226] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.270372] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.270521] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 28226e21-2062-44e4-8d0e-b8f214eeda26 is going to be created. [ 1084.316865] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.317124] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.317252] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.317542] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.317775] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.318048] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-28226e21-2062-44e4-8d0e-b8f214eeda26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.376122] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c000df34-07b2-4015-b824-73615ee8d750 in Status: SUCCESS [ 1084.376122] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c000df34-07b2-4015-b824-73615ee8d750 deletion is rescheduled due to dependency. [ 1084.376122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.631047] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1084.631292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.059913] env[66364]: INFO networking_nsxv3.common.synchronization [req-efbe1379-ae0b-4a80-8b7a-3374f839e1ac req-3c9a2492-3e66-4d18-8511-148e03da71cb service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 1085.059913] env[66364]: INFO networking_nsxv3.common.synchronization [req-efbe1379-ae0b-4a80-8b7a-3374f839e1ac req-3c9a2492-3e66-4d18-8511-148e03da71cb service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1085.059913] env[66364]: INFO networking_nsxv3.common.synchronization [req-efbe1379-ae0b-4a80-8b7a-3374f839e1ac req-3c9a2492-3e66-4d18-8511-148e03da71cb service nova] Enqueued Resource ID: 28226e21-2062-44e4-8d0e-b8f214eeda26 with Priority: HIGHEST for action port [ 1085.059913] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 1085.059913] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1085.059913] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28226e21-2062-44e4-8d0e-b8f214eeda26 with Priority: HIGHEST for action port [ 1085.059913] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.059913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.059913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.063054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.063054] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.063054] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.063054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.063054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.063054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.063054] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.063054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.063054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.063504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.063504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.063504] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.064949] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-28226e21-2062-44e4-8d0e-b8f214eeda26 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.064949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28226e21-2062-44e4-8d0e-b8f214eeda26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.064949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28226e21-2062-44e4-8d0e-b8f214eeda26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.064949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28226e21-2062-44e4-8d0e-b8f214eeda26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.064949] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28226e21-2062-44e4-8d0e-b8f214eeda26',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.566870] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.567315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.567315] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.572363] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28226e21-2062-44e4-8d0e-b8f214eeda26 with status ACTIVE [ 1085.572585] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.572714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.572782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.573043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.573138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.573308] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.573419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.573453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.573642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.573723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.573900] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.573994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.574264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.574264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.574315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.574383] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28226e21-2062-44e4-8d0e-b8f214eeda26 is going to be updated. [ 1085.596305] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.596449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.596521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.596733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.596875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.597045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28226e21-2062-44e4-8d0e-b8f214eeda26" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.881044] env[66364]: INFO networking_nsxv3.common.synchronization [None req-2f8882d8-20d8-499d-ab62-5f50ec23bc34 None None] Enqueued Resource ID: 772292fb-1875-48b0-8b70-60afab254ea2 with Priority: HIGHEST for action port [ 1085.881533] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 772292fb-1875-48b0-8b70-60afab254ea2 with Priority: HIGHEST for action port [ 1085.881825] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-772292fb-1875-48b0-8b70-60afab254ea2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.881952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-772292fb-1875-48b0-8b70-60afab254ea2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.882014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-772292fb-1875-48b0-8b70-60afab254ea2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.883119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-772292fb-1875-48b0-8b70-60afab254ea2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.883264] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('772292fb-1875-48b0-8b70-60afab254ea2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.076009] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.386064] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 772292fb-1875-48b0-8b70-60afab254ea2 [ 1086.387570] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.387570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.387570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.387570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.387570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.387570] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:772292fb-1875-48b0-8b70-60afab254ea2 already deleted. [ 1086.387570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-772292fb-1875-48b0-8b70-60afab254ea2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.580954] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.581175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.581248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.581435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.581524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.581621] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1086.616024] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.616024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.616024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.616024] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.616286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.627713] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1087.090178] env[66364]: INFO networking_nsxv3.common.synchronization [req-96c600ec-b87d-4175-920e-13de01e99977 req-3b5f81fb-1b4f-402a-90da-a2fe938447ee tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1087.090792] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1087.091127] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.091127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.091205] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.091369] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.091521] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.091618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.091677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.091825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.091974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.092090] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.598613] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.598613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.598613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.598613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.598613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.598613] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.598613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.598613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.598613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.598613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.598613] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1087.631243] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.631403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.631475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.631910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.632133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.644301] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1087.919160] env[66364]: INFO networking_nsxv3.common.synchronization [None req-b8dc3f10-56ba-4f6e-82c6-c8ca64955db1 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_rules [ 1087.919692] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_rules [ 1087.919989] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b30b154-6212-47c2-a13c-f42428185a75 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.921359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.921453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.921726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.921811] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.930271] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.930468] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.930840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.930840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.931206] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.931714] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.931714] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.931714] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.931867] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.932709] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.933355] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.933508] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.933640] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.933767] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.933879] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.934033] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.957075] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.957320] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1087.957478] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.957567] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.957877] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-f023b920-e324-4512-bf87-ecea05cde2b3 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.958118] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-f023b920-e324-4512-bf87-ecea05cde2b3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.958239] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-f023b920-e324-4512-bf87-ecea05cde2b3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.958550] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-f023b920-e324-4512-bf87-ecea05cde2b3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.958928] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f023b920-e324-4512-bf87-ecea05cde2b3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.041352] env[66364]: INFO networking_nsxv3.common.synchronization [None req-a469aff1-028c-45bb-821a-64a242897127 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_rules [ 1088.041352] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_rules [ 1088.041352] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b30b154-6212-47c2-a13c-f42428185a75 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.041352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.455752] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.456191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.456191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.456920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.456920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.456920] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b30b154-6212-47c2-a13c-f42428185a75 already deleted. [ 1088.456920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.456920] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.457223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.457223] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.462323] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.462549] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.462731] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.463116] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.463277] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.463431] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port f023b920-e324-4512-bf87-ecea05cde2b3 not found, creating... [ 1088.463703] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.463867] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.463983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.464239] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.464378] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.464670] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.464829] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.464973] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.465656] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.465854] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.466058] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: f023b920-e324-4512-bf87-ecea05cde2b3 is going to be created. [ 1088.489284] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.489556] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.489743] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.490083] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.490357] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.490629] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-f023b920-e324-4512-bf87-ecea05cde2b3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.640910] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1088.641132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.641314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.641653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.641846] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.642327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.642327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.642327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.642430] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.642462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.642593] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.914025] env[66364]: INFO networking_nsxv3.common.synchronization [None req-d98af8f3-ca09-424b-8dc9-84ae2741ba27 None None] Enqueued Resource ID: 2bdb9708-8e8a-4d2b-9788-19dccacf9d07 with Priority: HIGHEST for action port [ 1088.914025] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bdb9708-8e8a-4d2b-9788-19dccacf9d07 with Priority: HIGHEST for action port [ 1088.914025] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bdb9708-8e8a-4d2b-9788-19dccacf9d07 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.914025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bdb9708-8e8a-4d2b-9788-19dccacf9d07" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.914025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bdb9708-8e8a-4d2b-9788-19dccacf9d07" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.914025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bdb9708-8e8a-4d2b-9788-19dccacf9d07" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.914025] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bdb9708-8e8a-4d2b-9788-19dccacf9d07',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.979315] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.979858] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.979978] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.980264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.980390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.980515] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b30b154-6212-47c2-a13c-f42428185a75 already deleted. [ 1088.980713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.146256] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.146487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.146548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.146775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.146942] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.147061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.147211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.148368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.148368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.148368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.148368] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.148368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.148368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.148750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.148750] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.148750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.148750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.148934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.148934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.148934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.149074] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.248555] env[66364]: INFO networking_nsxv3.common.synchronization [req-96c600ec-b87d-4175-920e-13de01e99977 req-5966f75d-dd68-4964-b38b-e4bb7b6c9cf2 service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 1089.248555] env[66364]: INFO networking_nsxv3.common.synchronization [req-96c600ec-b87d-4175-920e-13de01e99977 req-5966f75d-dd68-4964-b38b-e4bb7b6c9cf2 service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1089.248555] env[66364]: INFO networking_nsxv3.common.synchronization [req-96c600ec-b87d-4175-920e-13de01e99977 req-5966f75d-dd68-4964-b38b-e4bb7b6c9cf2 service nova] Enqueued Resource ID: f023b920-e324-4512-bf87-ecea05cde2b3 with Priority: HIGHEST for action port [ 1089.251566] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 1089.251566] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1089.251566] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f023b920-e324-4512-bf87-ecea05cde2b3 with Priority: HIGHEST for action port [ 1089.253421] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.253421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.253421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.253421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.253594] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.254389] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.254507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.255111] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-f023b920-e324-4512-bf87-ecea05cde2b3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.255226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f023b920-e324-4512-bf87-ecea05cde2b3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.255305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f023b920-e324-4512-bf87-ecea05cde2b3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.255471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f023b920-e324-4512-bf87-ecea05cde2b3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.255548] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f023b920-e324-4512-bf87-ecea05cde2b3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.416964] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bdb9708-8e8a-4d2b-9788-19dccacf9d07 [ 1089.417460] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.417596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.417943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.417943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.418121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.418121] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bdb9708-8e8a-4d2b-9788-19dccacf9d07 already deleted. [ 1089.418206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bdb9708-8e8a-4d2b-9788-19dccacf9d07" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.651658] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 622b5ca5-0010-4122-b9d4-901a52d1aa5c: rpc.has_security_group_logging(os_id): False [ 1089.661710] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1089.661945] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 1089.662176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.662229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.662453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.662646] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.662788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.663073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.663073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.663138] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.665611] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.673967] env[66364]: INFO networking_nsxv3.common.synchronization [req-28a85613-0c05-4adf-9559-b177110ff7f3 req-dfb6c036-f3e0-4270-90f3-0ad9d059d91f tempest-ServerActionsTestOtherB-1668111998 tempest-ServerActionsTestOtherB-1668111998-project-member] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1089.674667] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1089.676226] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.676401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.676475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.676694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.676906] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.677041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.677121] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.677333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.677425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.677526] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.679134] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.679277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.679352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.679533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.679625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.679814] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.679914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.679980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.680156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.680294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.680491] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.680588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.680653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.680799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.680875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.681098] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.681209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.681296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.681456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.681536] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.681628] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1089.757864] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.758058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.758198] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f023b920-e324-4512-bf87-ecea05cde2b3 with status ACTIVE [ 1089.758565] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.758705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.758781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.759031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.759165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.759326] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.759428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.759484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.759677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.759792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.759954] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.760062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.760124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.760275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.760380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.760485] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f023b920-e324-4512-bf87-ecea05cde2b3 is going to be updated. [ 1089.764548] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.764710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.764751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.764997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.765177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.799737] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1089.809602] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.809602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.809704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.809987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.811018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.811018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f023b920-e324-4512-bf87-ecea05cde2b3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.069761] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.070747] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.070747] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.070747] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.070747] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.071038] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.071126] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.071375] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.071571] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.071868] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1090.072216] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.072216] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.075070] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.075070] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1090.075070] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.075070] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.096402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.096637] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1090.097520] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.097520] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.097623] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.097808] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.097936] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.098367] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.098449] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c432e30-08a1-478d-92ba-5fa9ec1a22fc',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.165282] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.188147] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.188746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.188885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.189233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.189491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.190616] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.190616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.190616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.190830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.190914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.191017] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1090.223031] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.223031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.223031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.223031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.223031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.232815] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1090.601250] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.601509] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.601718] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.602048] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.602848] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.602848] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 5c432e30-08a1-478d-92ba-5fa9ec1a22fc not found, creating... [ 1090.603248] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.603708] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.603867] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.604168] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.604908] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.606133] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.606133] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.606282] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.606539] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.607359] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.607359] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 5c432e30-08a1-478d-92ba-5fa9ec1a22fc is going to be created. [ 1090.631471] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.631795] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.631963] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.632279] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.632520] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.632747] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.667661] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.170726] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.170882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.170949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.171194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.171281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.172281] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1091.202189] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.202370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.202462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.202742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.202960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.213402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1091.393391] env[66364]: INFO networking_nsxv3.common.synchronization [req-28a85613-0c05-4adf-9559-b177110ff7f3 req-984dc1c8-aefc-4ee7-b747-70a2bd2c7166 service nova] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 1091.393639] env[66364]: INFO networking_nsxv3.common.synchronization [req-28a85613-0c05-4adf-9559-b177110ff7f3 req-984dc1c8-aefc-4ee7-b747-70a2bd2c7166 service nova] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1091.393842] env[66364]: INFO networking_nsxv3.common.synchronization [req-28a85613-0c05-4adf-9559-b177110ff7f3 req-984dc1c8-aefc-4ee7-b747-70a2bd2c7166 service nova] Enqueued Resource ID: 5c432e30-08a1-478d-92ba-5fa9ec1a22fc with Priority: HIGHEST for action port [ 1091.395495] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 1091.395633] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1091.395800] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c432e30-08a1-478d-92ba-5fa9ec1a22fc with Priority: HIGHEST for action port [ 1091.396412] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.396546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.396613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.396819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.396902] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.397852] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.397949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.398859] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.398991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.399077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.399267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.399350] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c432e30-08a1-478d-92ba-5fa9ec1a22fc',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.823754] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1091.824199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.901279] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.901468] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.901577] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c432e30-08a1-478d-92ba-5fa9ec1a22fc with status ACTIVE [ 1091.901740] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.901984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.901984] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.902166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.902258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.902436] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.902530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.902597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.902747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.902824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.903076] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.903170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.903170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.903324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.903410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.903516] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c432e30-08a1-478d-92ba-5fa9ec1a22fc is going to be updated. [ 1091.929232] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.929403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.929476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.929812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.929877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.930054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c432e30-08a1-478d-92ba-5fa9ec1a22fc" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.192996] env[66364]: INFO networking_nsxv3.common.synchronization [req-ae69095e-42a6-4bfd-a134-d551f436ac24 req-d32d65cc-5738-4dbd-9fc9-1707cc14dc25 tempest-ServerRescueNegativeTestJSON-1330136755 tempest-ServerRescueNegativeTestJSON-1330136755-project-member] Enqueued Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_members [ 1092.194107] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_members [ 1092.194566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df43df14-5db4-47e2-aec2-171f912259af taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.194779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.195095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.195289] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.195405] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.195790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.195790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.195877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.196232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.196299] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.244054] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1092.244054] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 deletion is rescheduled due to dependency. [ 1092.244054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.244054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.247997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.247997] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.247997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.247997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.247997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.247997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.247997] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.700914] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.700914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.700914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.700914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.700914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.700914] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.700914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.700914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.701420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.701420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.701420] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df43df14-5db4-47e2-aec2-171f912259af already deleted. [ 1092.701420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.711678] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-927 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.711678] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.711678] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.711933] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.712246] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.712404] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.712553] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.712860] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.713083] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.713322] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.713441] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.713540] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.713648] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.713758] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.713862] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.713991] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.736758] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.736939] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.737092] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.737274] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-927" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.737587] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.737762] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.737879] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.738236] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.738374] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.750372] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.224136] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1093.224407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.224530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.224738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.225033] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.225160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.225223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.225390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.225470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.225553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.225640] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.240835] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.241088] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.241185] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.241461] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.241607] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.241756] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b not found, creating... [ 1093.242018] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.242285] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.242411] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.244238] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.244238] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.244238] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.244238] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.244238] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.244238] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.244238] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.244238] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b is going to be created. [ 1093.252396] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.265618] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.265709] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.265757] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.266079] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.266311] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.266529] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.727743] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.728153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.728328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.728721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.728950] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.729301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.730134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.730134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.730134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.730134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.730854] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.730854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.730854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.730854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.731019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.731019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.731288] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.731288] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.731409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.731467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.731634] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.757959] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.757959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.757959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.757959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.757959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.757959] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1093.790137] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.790319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.790394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.790635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.790786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.807028] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1094.083243] env[66364]: INFO networking_nsxv3.common.synchronization [req-ae69095e-42a6-4bfd-a134-d551f436ac24 req-b42e5a2c-dae4-4890-a28e-90a00f4b98e7 service nova] Enqueued Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_rules [ 1094.083752] env[66364]: INFO networking_nsxv3.common.synchronization [req-ae69095e-42a6-4bfd-a134-d551f436ac24 req-b42e5a2c-dae4-4890-a28e-90a00f4b98e7 service nova] Enqueued Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_members [ 1094.084754] env[66364]: INFO networking_nsxv3.common.synchronization [req-ae69095e-42a6-4bfd-a134-d551f436ac24 req-b42e5a2c-dae4-4890-a28e-90a00f4b98e7 service nova] Enqueued Resource ID: 7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b with Priority: HIGHEST for action port [ 1094.085116] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_rules [ 1094.085268] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_members [ 1094.085469] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b with Priority: HIGHEST for action port [ 1094.085893] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df43df14-5db4-47e2-aec2-171f912259af taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.086061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.086117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.086320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.086406] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.088141] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df43df14-5db4-47e2-aec2-171f912259af taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.088371] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.088499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.088829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.089106] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.089310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.089432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.089735] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.089896] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.090309] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.091828] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.091966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.092044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.092242] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.092300] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.235114] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e327b378-51f2-4bc5-8b1c-697b0302c4a5: rpc.has_security_group_logging(os_id): False [ 1094.257756] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.257906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.258073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.258209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.258339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.258558] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.258613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.258724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.258905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.258976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.259179] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.259273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.259336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.259488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.259589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.259839] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.259968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.260059] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.260260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.260370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.260499] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1094.387900] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.388968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.389173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.389563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.389817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.453856] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1094.595878] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df43df14-5db4-47e2-aec2-171f912259af taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.595878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.595878] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.596773] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b with status ACTIVE [ 1094.596935] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.597099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.597166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.597401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.597658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.597724] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.597795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.597973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.598272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.598272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.598358] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.598489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.598489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.599161] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.599161] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.599161] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b is going to be updated. [ 1094.630089] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.630363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.630447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.630685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.631058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.631342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fbfc459-4a9f-4e47-ac2d-dcbb8591b64b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.104369] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.191112] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.191452] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.191647] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.192376] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.192546] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.192785] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.192906] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.193311] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.193515] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.193739] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.193855] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.193967] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.194108] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.194304] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.194500] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.194680] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.215922] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.216283] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.216462] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.216644] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-580" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.217142] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-9630e5f1-77be-4e60-9df4-392603020f17 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.217444] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.217653] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.217987] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.218268] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9630e5f1-77be-4e60-9df4-392603020f17',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.607093] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.607428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.607428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.607604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.607694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.607788] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df43df14-5db4-47e2-aec2-171f912259af is going to be created. [ 1095.634973] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.634973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.635292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.635292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.635453] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.653570] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df43df14-5db4-47e2-aec2-171f912259af in Status: UNINITIALIZED for 2s [ 1095.722030] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.722030] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.722306] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.722406] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.722775] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.722894] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.723199] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.723358] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.723609] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.723755] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.724094] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.724304] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.724404] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.724624] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.724805] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.724903] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 9630e5f1-77be-4e60-9df4-392603020f17 is going to be updated. [ 1095.750197] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.750449] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.750574] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.750855] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.751151] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.751429] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.814773] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1095.814890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.815063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.815942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.815942] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.815942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.815942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.815942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.816372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.816372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.816372] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.822111] env[66364]: INFO networking_nsxv3.common.synchronization [req-b5c84634-441b-45ba-b467-f79e692fea08 req-a9b56863-bf14-4f6a-8251-9bfc47d8bcd4 tempest-ServersNegativeTestJSON-73704894 tempest-ServersNegativeTestJSON-73704894-project-member] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 1095.823311] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGHEST for action security_group_members [ 1095.823474] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.823658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.823737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.823935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.824137] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.824240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.824318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.824486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.824581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.824730] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.318769] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.326775] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.326958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.327046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.327307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.327415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.327688] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.327825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.327944] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.328200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.328614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.328614] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be updated. [ 1096.371701] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.372853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.372853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.372853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.372853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.384385] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: IN_PROGRESS for 2s [ 1096.475537] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1096.475840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.483154] env[66364]: INFO networking_nsxv3.common.synchronization [req-16c0ec01-dcdf-4c21-a1ff-73ebd454fa24 req-e2775e51-3782-4e60-ae31-6ed2bd71e2fa service nova] Enqueued Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_rules [ 1096.483389] env[66364]: INFO networking_nsxv3.common.synchronization [req-16c0ec01-dcdf-4c21-a1ff-73ebd454fa24 req-e2775e51-3782-4e60-ae31-6ed2bd71e2fa service nova] Enqueued Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_members [ 1096.483569] env[66364]: INFO networking_nsxv3.common.synchronization [req-16c0ec01-dcdf-4c21-a1ff-73ebd454fa24 req-e2775e51-3782-4e60-ae31-6ed2bd71e2fa service nova] Enqueued Resource ID: 9630e5f1-77be-4e60-9df4-392603020f17 with Priority: HIGHEST for action port [ 1096.484186] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_rules [ 1096.484387] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_members [ 1096.484613] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9630e5f1-77be-4e60-9df4-392603020f17 with Priority: HIGHEST for action port [ 1096.485009] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.485176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.485248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.485490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.485596] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.487598] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.487793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.487994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.488113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.488265] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.488401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.488475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.488819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.488819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.488936] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.489813] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9630e5f1-77be-4e60-9df4-392603020f17 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.489909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.490030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.490221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.490276] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9630e5f1-77be-4e60-9df4-392603020f17',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.821643] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85f93bd5-5dca-472e-a30a-fd77d873bad8: rpc.has_security_group_logging(os_id): False [ 1096.842267] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.842460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.842500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.842688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.842776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.843080] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.843226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.843226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.843384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.843459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.843545] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1096.917021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.917283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.917283] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.917501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.917669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.931657] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1096.992264] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.993475] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.993634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.993742] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9630e5f1-77be-4e60-9df4-392603020f17 with status ACTIVE [ 1096.993916] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.994070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.994218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.994341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.994438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.994621] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.994739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.994787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.995044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.995828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.995828] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.996122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.996209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.996363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.996451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.996538] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9630e5f1-77be-4e60-9df4-392603020f17 is going to be updated. [ 1097.021396] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.021574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.021662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.021940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.022171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.022421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9630e5f1-77be-4e60-9df4-392603020f17" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.500085] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.664064] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df43df14-5db4-47e2-aec2-171f912259af in Status: SUCCESS [ 1097.664424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.664619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.664898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.665212] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.665358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.665419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.665617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.665707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.665859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.665905] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.002319] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.002711] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.002711] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.002807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.002881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.003313] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d105259-6c05-4d26-aa23-5631556fbf46 is going to be updated. [ 1098.040682] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.040835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.040903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.041256] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.041686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.055712] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: IN_PROGRESS for 2s [ 1098.166776] env[66364]: INFO networking_nsxv3.common.synchronization [req-161a04ce-d06e-40e5-80e7-82d2d8fbde5c req-a239dd17-db57-4c17-aa2f-9a0de5886923 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1098.166776] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1098.167537] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.167537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.167537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.167785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.170046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.170046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.170046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.170046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.170046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.170046] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.170657] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.407062] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c in Status: SUCCESS [ 1098.407266] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c deletion is rescheduled due to dependency. [ 1098.407365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.647443] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.647733] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.647847] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.648247] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.648997] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.649213] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.649362] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.649671] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.649861] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.650101] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.650223] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.650345] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.650468] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.650583] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1098.650690] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.650823] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.674525] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.674890] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1098.674890] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.675210] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.675666] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-09278866-f41c-4f3d-919a-6472ba8a22ed taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.675873] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-09278866-f41c-4f3d-919a-6472ba8a22ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.676816] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-09278866-f41c-4f3d-919a-6472ba8a22ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.676816] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-09278866-f41c-4f3d-919a-6472ba8a22ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.676816] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09278866-f41c-4f3d-919a-6472ba8a22ed',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.677877] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df43df14-5db4-47e2-aec2-171f912259af: rpc.has_security_group_logging(os_id): False [ 1098.679169] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.679324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.679402] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.679604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.679693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.679923] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.680027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.680091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.680303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.680424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.680812] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c already deleted. [ 1098.680812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.699667] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.699849] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.699924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.700220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.700381] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.700689] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.700805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.700885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.701111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.701246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.701378] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df43df14-5db4-47e2-aec2-171f912259af is going to be created. [ 1098.769968] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.769968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.769968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.769968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.770335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.783244] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df43df14-5db4-47e2-aec2-171f912259af in Status: IN_PROGRESS for 2s [ 1098.810027] env[66364]: INFO networking_nsxv3.common.synchronization [req-3b8a3660-b2f4-4d38-89af-742bb065acd7 req-a772396d-22d7-423b-8851-dc3815eb5257 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1098.810345] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1098.810587] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.810705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.810705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.810862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.811218] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.811218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.811218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.811364] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.811480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.811556] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.948052] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1098.948463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.183763] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.183763] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.183763] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.183763] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.183763] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.183763] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 09278866-f41c-4f3d-919a-6472ba8a22ed not found, creating... [ 1099.184237] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.184237] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.184237] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.185023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.185023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.185224] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.185520] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.185634] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.185979] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.186167] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.186382] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 09278866-f41c-4f3d-919a-6472ba8a22ed is going to be created. [ 1099.212207] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.212436] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.212558] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.212841] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.213195] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.213443] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-09278866-f41c-4f3d-919a-6472ba8a22ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.314956] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.640728] env[66364]: INFO networking_nsxv3.common.synchronization [req-f2d31af9-0b14-455b-aafc-2d680b0dc1e4 req-efda571c-7b3e-4c4b-8a37-bf783db43161 tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_members [ 1099.641374] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGHEST for action security_group_members [ 1099.641767] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.641917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.641992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.642248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.642411] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.642548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.642627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.642889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.643035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.643144] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.816442] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.994023] env[66364]: INFO networking_nsxv3.common.synchronization [req-161a04ce-d06e-40e5-80e7-82d2d8fbde5c req-8a6ef7d4-b854-4176-bcae-07b87c5d0f28 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1099.994109] env[66364]: INFO networking_nsxv3.common.synchronization [req-161a04ce-d06e-40e5-80e7-82d2d8fbde5c req-8a6ef7d4-b854-4176-bcae-07b87c5d0f28 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1099.994244] env[66364]: INFO networking_nsxv3.common.synchronization [req-161a04ce-d06e-40e5-80e7-82d2d8fbde5c req-8a6ef7d4-b854-4176-bcae-07b87c5d0f28 service nova] Enqueued Resource ID: 09278866-f41c-4f3d-919a-6472ba8a22ed with Priority: HIGHEST for action port [ 1099.994755] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1099.994908] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1099.995663] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09278866-f41c-4f3d-919a-6472ba8a22ed with Priority: HIGHEST for action port [ 1099.996207] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.996439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.996474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.996732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.996820] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.997843] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.997983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.998070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.998302] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.998460] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.998573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.998641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.998793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.998879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.998968] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.005709] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-09278866-f41c-4f3d-919a-6472ba8a22ed taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.005709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09278866-f41c-4f3d-919a-6472ba8a22ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.005709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09278866-f41c-4f3d-919a-6472ba8a22ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.005709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09278866-f41c-4f3d-919a-6472ba8a22ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.005709] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09278866-f41c-4f3d-919a-6472ba8a22ed',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.066248] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: SUCCESS [ 1100.066584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.066744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.066960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.067180] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.067376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.067449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.067616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.067701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.067782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.067869] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.147518] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.147828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.147828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.148267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.148267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.148267] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.148395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.148395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.148545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.148624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.152147] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40420088-ac97-4318-add0-c3b84e42921a is going to be updated. [ 1100.185070] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.185378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.185378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.185620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.186760] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.196293] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40420088-ac97-4318-add0-c3b84e42921a in Status: IN_PROGRESS for 2s [ 1100.283546] env[66364]: INFO networking_nsxv3.common.synchronization [None req-a5ba266f-4f51-4c61-ad97-b8e576cd2cc7 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1100.283825] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1100.284168] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.284278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.324541] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.324695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.324768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.325106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.325180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.325240] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1100.372135] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.372317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.372435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.372852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.373174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.385330] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1100.509660] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.509660] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.509660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.509660] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09278866-f41c-4f3d-919a-6472ba8a22ed with status ACTIVE [ 1100.509660] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.509660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.509660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.509660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.509660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.509660] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.509660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.509660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.510294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.510294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.510294] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.510294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.510431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.511455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.511455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.511455] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09278866-f41c-4f3d-919a-6472ba8a22ed is going to be updated. [ 1100.538879] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.539085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.539085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.539307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.539449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.539608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09278866-f41c-4f3d-919a-6472ba8a22ed" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.573578] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.797561] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df43df14-5db4-47e2-aec2-171f912259af in Status: SUCCESS [ 1100.797561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.012455] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.076116] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d105259-6c05-4d26-aa23-5631556fbf46: rpc.has_security_group_logging(os_id): False [ 1101.095808] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.096072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.096072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.096286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.115787] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.116257] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.116427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.116496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.116713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.116796] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.116890] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d105259-6c05-4d26-aa23-5631556fbf46 is going to be updated. [ 1101.165549] env[66364]: INFO networking_nsxv3.common.synchronization [req-bf294308-0142-470d-9059-6c42001fe8ca req-4bf0650a-1ed4-44cf-a130-121db956b261 tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_members [ 1101.167049] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_members [ 1101.167534] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b30b154-6212-47c2-a13c-f42428185a75 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.167756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.167756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.168274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.168274] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.168470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.168470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.168558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.168596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.168758] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.181905] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.182070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.182128] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.182334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.182479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.198420] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: IN_PROGRESS for 2s [ 1101.516979] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.517159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.517246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.517522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.517615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.517717] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be created. [ 1101.548019] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.548296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.548296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.548586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.548805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.563216] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: UNINITIALIZED for 2s [ 1101.637897] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.638119] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.638335] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.638613] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.638869] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.642502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.642502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.642502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.642502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.642982] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.642982] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.642982] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.642982] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.642982] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.643184] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.643218] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.670283] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.670499] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.670675] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.670893] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-861" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.671298] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-c889e077-637d-40cd-b020-dc23a1c4ae41 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.671502] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-c889e077-637d-40cd-b020-dc23a1c4ae41" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.671806] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-c889e077-637d-40cd-b020-dc23a1c4ae41" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.672039] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-c889e077-637d-40cd-b020-dc23a1c4ae41" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.672193] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c889e077-637d-40cd-b020-dc23a1c4ae41',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.673347] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.673486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.673579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.673782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.674624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.674624] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.674624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.674624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.674624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.674624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.674624] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b30b154-6212-47c2-a13c-f42428185a75 already deleted. [ 1101.675108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.176090] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.177090] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.177291] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.177586] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.177742] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.177901] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port c889e077-637d-40cd-b020-dc23a1c4ae41 not found, creating... [ 1102.178322] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.178550] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.178646] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.178888] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.179038] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.179484] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.179689] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.179862] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.180376] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.180721] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.180875] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: c889e077-637d-40cd-b020-dc23a1c4ae41 is going to be created. [ 1102.206660] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40420088-ac97-4318-add0-c3b84e42921a in Status: SUCCESS [ 1102.206920] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40420088-ac97-4318-add0-c3b84e42921a deletion is rescheduled due to dependency. [ 1102.207076] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.208376] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.208726] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.208875] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.213401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.213834] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.215209] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-c889e077-637d-40cd-b020-dc23a1c4ae41" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.403547] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1102.403782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.403963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.404204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.404404] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.404532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.404599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.404755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.404917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.405086] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.908879] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.909204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.909337] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.909709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.909867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.910225] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.910400] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.910550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.910778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.910903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.911060] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1102.944267] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.944521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.944602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.944823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.944963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.949837] env[66364]: INFO networking_nsxv3.common.synchronization [req-bf294308-0142-470d-9059-6c42001fe8ca req-a821298b-e5da-41c4-ba63-1a8ad3e66ea6 service nova] Enqueued Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_rules [ 1102.951611] env[66364]: INFO networking_nsxv3.common.synchronization [req-bf294308-0142-470d-9059-6c42001fe8ca req-a821298b-e5da-41c4-ba63-1a8ad3e66ea6 service nova] Enqueued Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_members [ 1102.951611] env[66364]: INFO networking_nsxv3.common.synchronization [req-bf294308-0142-470d-9059-6c42001fe8ca req-a821298b-e5da-41c4-ba63-1a8ad3e66ea6 service nova] Enqueued Resource ID: c889e077-637d-40cd-b020-dc23a1c4ae41 with Priority: HIGHEST for action port [ 1102.951611] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_rules [ 1102.951611] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_members [ 1102.951611] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c889e077-637d-40cd-b020-dc23a1c4ae41 with Priority: HIGHEST for action port [ 1102.951611] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b30b154-6212-47c2-a13c-f42428185a75 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.951611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.951611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.952227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.952227] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.954301] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b30b154-6212-47c2-a13c-f42428185a75 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.954522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.954700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.955031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.955438] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.955610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.955706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.955921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.956105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.956229] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.958712] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c889e077-637d-40cd-b020-dc23a1c4ae41 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.958712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c889e077-637d-40cd-b020-dc23a1c4ae41" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.958712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c889e077-637d-40cd-b020-dc23a1c4ae41" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.958712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c889e077-637d-40cd-b020-dc23a1c4ae41" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.958712] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c889e077-637d-40cd-b020-dc23a1c4ae41',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.960779] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1103.218595] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: SUCCESS [ 1103.219147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.460871] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c889e077-637d-40cd-b020-dc23a1c4ae41 with status ACTIVE [ 1103.461290] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.461611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.461698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.462133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.462133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.462403] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.462559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.462641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.462950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.463104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.463556] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.463654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.463685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.463909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.464049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.464235] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c889e077-637d-40cd-b020-dc23a1c4ae41 is going to be updated. [ 1103.465544] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b30b154-6212-47c2-a13c-f42428185a75 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.465661] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.465936] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.496459] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.496654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.496763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.496960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.497145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.497317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c889e077-637d-40cd-b020-dc23a1c4ae41" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.582332] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1103.582601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.582931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.583280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.583523] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.583718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.583794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.584075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.584195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.584370] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.584946] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.969508] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.166385] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.166570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.166614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.166806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.166967] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.167077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.167140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.167288] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.167390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.167474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.167619] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.167706] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.167763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.167898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.168161] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.168161] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.168266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.168414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.168489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.168570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.168652] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.170972] env[66364]: INFO networking_nsxv3.common.synchronization [req-abe9f6f4-9cf3-49b1-a422-5aefae03915e req-3c7dd168-73a3-40bb-837d-b1b7ef4c1d20 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_members [ 1104.171780] env[66364]: INFO networking_nsxv3.common.synchronization [req-8d5aa329-2f8a-48f0-9c9b-fd6932502e45 req-a705ccb1-ea97-479c-bc35-a6cb03565d07 tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1104.174518] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f with Priority: HIGHEST for action security_group_members [ 1104.174703] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1104.175218] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-d452681b-1b53-41c8-868e-1a2a30ac3a1f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.175336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.175388] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.175675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.175736] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.175816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.175873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.176057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.176208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.176241] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d452681b-1b53-41c8-868e-1a2a30ac3a1f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.177263] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.178244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.178244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.178244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.178244] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.178244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.178244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.178244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.178498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.178498] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.472586] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.472947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.472947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.473136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.473943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.473943] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b30b154-6212-47c2-a13c-f42428185a75 is going to be created. [ 1104.511765] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.511971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.511971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.512446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.512613] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.524760] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b30b154-6212-47c2-a13c-f42428185a75 in Status: UNINITIALIZED for 2s [ 1104.673770] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c: rpc.has_security_group_logging(os_id): False [ 1104.680682] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.680903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.681022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.681409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.682868] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.682868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.698832] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.699022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.707107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.707430] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.707591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.707643] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.707877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.707938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.708075] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f is going to be updated. [ 1104.709218] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.709657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.709657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.709657] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.709806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.709806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.710039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.710039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.710122] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1104.711398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.711569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.711653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.711866] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.711968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.712070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.712483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.712564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.712770] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.712868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.713195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.713195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.713195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.713406] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.713406] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.713486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.713591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.713664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.713746] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be created. [ 1104.756637] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.756843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.756843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.757029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.757249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.759538] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.759538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.759791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.759855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.761417] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.772761] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f in Status: IN_PROGRESS for 2s [ 1104.773689] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1104.795257] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.795624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.795700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.795934] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.796198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.814733] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1104.974602] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1104.975730] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c deletion is rescheduled due to dependency. [ 1104.976185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.536826] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b30b154-6212-47c2-a13c-f42428185a75 in Status: SUCCESS [ 1106.536826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.537141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.537176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.537778] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.537778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.537778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.537778] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.538021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.538021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.538076] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.785782] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f in Status: SUCCESS [ 1106.785782] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d452681b-1b53-41c8-868e-1a2a30ac3a1f deletion is rescheduled due to dependency. [ 1106.785782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d452681b-1b53-41c8-868e-1a2a30ac3a1f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.792993] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1106.792993] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 1106.792993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.827918] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1106.828331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.040328] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.542405] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b30b154-6212-47c2-a13c-f42428185a75: rpc.has_security_group_logging(os_id): False [ 1107.563286] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.563477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.563537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.563726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.563814] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.564072] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.564176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.564228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.564396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.564462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.564551] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b30b154-6212-47c2-a13c-f42428185a75 is going to be created. [ 1107.628046] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.628046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.628285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.628341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.628487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.642716] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b30b154-6212-47c2-a13c-f42428185a75 in Status: IN_PROGRESS for 2s [ 1109.175707] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1109.175707] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1109.660848] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b30b154-6212-47c2-a13c-f42428185a75 in Status: SUCCESS [ 1109.662040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.427974] env[66364]: INFO networking_nsxv3.common.synchronization [req-bdde54a3-f722-40ba-ab97-5d5880f04517 req-e2774d58-c72f-472a-be80-a233b280937f tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 1112.428590] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 1112.428912] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.429188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.429188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.429303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.429437] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.429538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.429600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.429746] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.429831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.429940] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.783647] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-319 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.783862] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.783983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.784275] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.784536] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.784689] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.784802] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.785117] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.785195] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.785407] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.785517] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.785620] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.785724] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.785830] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.785933] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.786089] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.808182] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.808368] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1112.808552] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.808766] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-319" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.809118] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-e9aec855-3053-49a8-8743-6ec4a6e8337e taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.809298] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-e9aec855-3053-49a8-8743-6ec4a6e8337e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.809418] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-e9aec855-3053-49a8-8743-6ec4a6e8337e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.809826] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-e9aec855-3053-49a8-8743-6ec4a6e8337e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.809985] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9aec855-3053-49a8-8743-6ec4a6e8337e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.934353] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.313009] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.313314] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.313514] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.314014] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.314210] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.314375] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port e9aec855-3053-49a8-8743-6ec4a6e8337e not found, creating... [ 1113.314680] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.314846] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.314964] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.315260] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.315401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.315697] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.315850] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.315967] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.316232] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.316371] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.316513] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: e9aec855-3053-49a8-8743-6ec4a6e8337e is going to be created. [ 1113.341290] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.341550] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.341719] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.342041] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.342343] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.342654] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-e9aec855-3053-49a8-8743-6ec4a6e8337e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.437256] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.941304] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.941455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.941531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.941815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.941889] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.942052] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be updated. [ 1113.975013] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.975216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.975286] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.975494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.975639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.985784] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: IN_PROGRESS for 2s [ 1114.074612] env[66364]: INFO networking_nsxv3.common.synchronization [req-bdde54a3-f722-40ba-ab97-5d5880f04517 req-7a4f08ec-ead6-4bd3-9739-9e6038237ebe service nova] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_rules [ 1114.074612] env[66364]: INFO networking_nsxv3.common.synchronization [req-bdde54a3-f722-40ba-ab97-5d5880f04517 req-7a4f08ec-ead6-4bd3-9739-9e6038237ebe service nova] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 1114.074612] env[66364]: INFO networking_nsxv3.common.synchronization [req-bdde54a3-f722-40ba-ab97-5d5880f04517 req-7a4f08ec-ead6-4bd3-9739-9e6038237ebe service nova] Enqueued Resource ID: e9aec855-3053-49a8-8743-6ec4a6e8337e with Priority: HIGHEST for action port [ 1114.074612] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_rules [ 1114.074612] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 1114.074612] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9aec855-3053-49a8-8743-6ec4a6e8337e with Priority: HIGHEST for action port [ 1114.074612] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.074612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.074612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.075134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.075134] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.075758] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.075862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.076047] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9aec855-3053-49a8-8743-6ec4a6e8337e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.076154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9aec855-3053-49a8-8743-6ec4a6e8337e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.076240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9aec855-3053-49a8-8743-6ec4a6e8337e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.076405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9aec855-3053-49a8-8743-6ec4a6e8337e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.076455] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9aec855-3053-49a8-8743-6ec4a6e8337e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.578225] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.578546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.582641] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9aec855-3053-49a8-8743-6ec4a6e8337e with status ACTIVE [ 1114.585658] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.585658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.585658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.585658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.585658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.585658] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.585658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.585658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.585658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.585658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.585658] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.585658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.586718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.586718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.586718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.586718] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9aec855-3053-49a8-8743-6ec4a6e8337e is going to be updated. [ 1114.618065] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.618382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.618382] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.618683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.618959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.619146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9aec855-3053-49a8-8743-6ec4a6e8337e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.998414] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: SUCCESS [ 1115.998717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.000886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.000886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.000886] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.000886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.000886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.000886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.000886] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.000886] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.439285] env[66364]: INFO networking_nsxv3.common.synchronization [None req-11f756f9-d87e-48e4-9c9f-0f6462d0f2a2 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_rules [ 1116.439634] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_rules [ 1116.441977] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.441977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.441977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.441977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.441977] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.503252] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.540138] env[66364]: INFO networking_nsxv3.common.synchronization [None req-62114e29-6b1c-46eb-be24-790c2304070b tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_rules [ 1116.540947] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_rules [ 1116.541064] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.541115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.963980] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.963980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.963980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.964271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.964306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.964429] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 already deleted. [ 1116.964561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.964758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.964979] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.965150] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.006856] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.486415] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.486546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.486601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.486807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.486895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.486991] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 already deleted. [ 1117.487123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.508956] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.509104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.509250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.509394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.509485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.509596] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be updated. [ 1117.543793] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.544010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.544107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.544389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.544571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.557398] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: IN_PROGRESS for 2s [ 1118.665031] env[66364]: INFO networking_nsxv3.common.synchronization [req-a26fe4dc-5b2d-4f60-bb7a-f72853d0c16a req-f6c4b3b1-4bf2-4cec-bbcc-824c04b48c53 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1118.665747] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1118.666517] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.666517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.666517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.666702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.667271] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.667271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.667271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.667271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.667514] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.667514] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.008964] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.009229] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.009563] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.009891] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.010746] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.010746] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.010746] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.010927] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.011014] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.012013] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.012013] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.012013] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.012013] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.012013] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.012013] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.012013] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.032949] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.033152] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1119.033305] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.033490] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.033825] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-6eee5eca-d6d0-47ba-b855-b22d549c3f20 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.034011] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-6eee5eca-d6d0-47ba-b855-b22d549c3f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.034139] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-6eee5eca-d6d0-47ba-b855-b22d549c3f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.034617] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-6eee5eca-d6d0-47ba-b855-b22d549c3f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.034816] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eee5eca-d6d0-47ba-b855-b22d549c3f20',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.169626] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.537663] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.537965] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.538114] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.538578] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.538855] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.539118] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 6eee5eca-d6d0-47ba-b855-b22d549c3f20 not found, creating... [ 1119.539842] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.540109] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.540303] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.540615] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.540839] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.541274] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.541511] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.541674] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.541979] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.542126] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.542306] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 6eee5eca-d6d0-47ba-b855-b22d549c3f20 is going to be created. [ 1119.570071] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: SUCCESS [ 1119.570363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.570594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.570899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.571176] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.571363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.571409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.572139] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.572265] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.572436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.572569] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.575171] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.575435] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.575614] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.575943] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.576267] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.576608] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-6eee5eca-d6d0-47ba-b855-b22d549c3f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.671409] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.078708] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.174247] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.174383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.174383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.175074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.175074] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.175074] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1120.205561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.205739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.205779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.205976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.206149] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.216654] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1120.257935] env[66364]: INFO networking_nsxv3.common.synchronization [req-a26fe4dc-5b2d-4f60-bb7a-f72853d0c16a req-11c81bff-3bd6-41ee-9090-ab49bdbc0885 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1120.258128] env[66364]: INFO networking_nsxv3.common.synchronization [req-a26fe4dc-5b2d-4f60-bb7a-f72853d0c16a req-11c81bff-3bd6-41ee-9090-ab49bdbc0885 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1120.258317] env[66364]: INFO networking_nsxv3.common.synchronization [req-a26fe4dc-5b2d-4f60-bb7a-f72853d0c16a req-11c81bff-3bd6-41ee-9090-ab49bdbc0885 service nova] Enqueued Resource ID: 6eee5eca-d6d0-47ba-b855-b22d549c3f20 with Priority: HIGHEST for action port [ 1120.258887] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1120.259037] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1120.259134] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eee5eca-d6d0-47ba-b855-b22d549c3f20 with Priority: HIGHEST for action port [ 1120.259403] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.259521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.259596] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.259775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.259853] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.260823] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.260939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.261486] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eee5eca-d6d0-47ba-b855-b22d549c3f20 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.261648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eee5eca-d6d0-47ba-b855-b22d549c3f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.261711] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eee5eca-d6d0-47ba-b855-b22d549c3f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.261884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eee5eca-d6d0-47ba-b855-b22d549c3f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.261956] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eee5eca-d6d0-47ba-b855-b22d549c3f20',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.581617] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad194291-e1d7-48e3-b3d4-5e26a902dc4b: rpc.has_security_group_logging(os_id): False [ 1120.607654] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.607847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.607917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.608271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.608446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.609188] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.609188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.609188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.609188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.609375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.609375] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be updated. [ 1120.697508] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.697859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.697859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.697960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.698135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.717689] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: IN_PROGRESS for 2s [ 1120.764414] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.764414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.765732] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6eee5eca-d6d0-47ba-b855-b22d549c3f20 with status ACTIVE [ 1120.765946] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.766488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.766488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.766488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.766488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.766690] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.766830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.766879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.767747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.767747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.767747] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.767747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.767747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.767747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.767747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.767747] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6eee5eca-d6d0-47ba-b855-b22d549c3f20 is going to be updated. [ 1120.809293] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.809293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.809569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.809722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.809860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.810110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eee5eca-d6d0-47ba-b855-b22d549c3f20" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.229146] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 4s [ 1122.733576] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: SUCCESS [ 1122.733856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.507472] env[66364]: INFO networking_nsxv3.common.synchronization [req-9209803a-9d0c-412e-a092-924fe8930c8e req-5e6ee712-fac9-4f59-a935-38e1ba084ab0 tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1123.507977] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1123.508290] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.508412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.508478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.508664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.508816] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.508912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.509418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.509586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.509677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.509766] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.883644] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.883814] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.883937] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.884243] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.884521] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.884684] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.884795] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.885018] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.885200] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.885404] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.885532] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.885628] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.885739] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.885848] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.885953] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.886096] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.907480] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.907480] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.907480] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.907480] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-594" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.907785] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-6c928d47-359a-4acd-a902-e36e1e556505 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.907899] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-6c928d47-359a-4acd-a902-e36e1e556505" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.908024] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-6c928d47-359a-4acd-a902-e36e1e556505" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.908356] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-6c928d47-359a-4acd-a902-e36e1e556505" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.908665] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c928d47-359a-4acd-a902-e36e1e556505',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.013918] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.013918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.013918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.013918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.013918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.013918] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.013918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.013918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.013918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.014457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.014457] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1124.040988] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.040988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.041259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.041259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.041394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.052219] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1124.239613] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1124.239835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.240010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.240246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.240438] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.240556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.240619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.240774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.240854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.240945] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.410906] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.411168] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.411300] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.411602] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.411766] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.411928] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 6c928d47-359a-4acd-a902-e36e1e556505 not found, creating... [ 1124.412241] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.412520] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.412610] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.412822] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.412957] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.413319] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.413508] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.413593] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.413801] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.413929] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.414091] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 6c928d47-359a-4acd-a902-e36e1e556505 is going to be created. [ 1124.438217] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.438441] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.438620] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.438938] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.439204] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.439428] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-6c928d47-359a-4acd-a902-e36e1e556505" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.744162] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.151538] env[66364]: INFO networking_nsxv3.common.synchronization [req-9209803a-9d0c-412e-a092-924fe8930c8e req-2be9e802-c8c9-4b58-b0f9-4655f5f8347f service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 1125.151715] env[66364]: INFO networking_nsxv3.common.synchronization [req-9209803a-9d0c-412e-a092-924fe8930c8e req-2be9e802-c8c9-4b58-b0f9-4655f5f8347f service nova] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1125.151846] env[66364]: INFO networking_nsxv3.common.synchronization [req-9209803a-9d0c-412e-a092-924fe8930c8e req-2be9e802-c8c9-4b58-b0f9-4655f5f8347f service nova] Enqueued Resource ID: 6c928d47-359a-4acd-a902-e36e1e556505 with Priority: HIGHEST for action port [ 1125.153028] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_rules [ 1125.153028] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1125.153028] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c928d47-359a-4acd-a902-e36e1e556505 with Priority: HIGHEST for action port [ 1125.153028] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.153028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.153334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.153334] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.153391] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.154276] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.154276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.154459] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c928d47-359a-4acd-a902-e36e1e556505 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.154557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c928d47-359a-4acd-a902-e36e1e556505" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.154616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c928d47-359a-4acd-a902-e36e1e556505" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.154776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c928d47-359a-4acd-a902-e36e1e556505" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.154850] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c928d47-359a-4acd-a902-e36e1e556505',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.247101] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.657070] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.657070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.657070] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c928d47-359a-4acd-a902-e36e1e556505 with status ACTIVE [ 1125.657070] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.657070] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.657473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.657473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.657559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.657718] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.657851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.657922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.658100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.658178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.658357] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.658447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.658505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.658640] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.658710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.658789] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c928d47-359a-4acd-a902-e36e1e556505 is going to be updated. [ 1125.682533] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.682718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.682764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.682967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.683268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.683503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c928d47-359a-4acd-a902-e36e1e556505" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.751441] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.751733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.751733] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.751909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.752077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.752190] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1125.782672] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.782879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.782879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.783153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.783429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.810278] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1126.041667] env[66364]: INFO networking_nsxv3.common.synchronization [req-d97a05e5-e777-4c61-a099-802b995d55bf req-9354b999-d6d6-45a3-b211-443aabdc848f tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1126.041667] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1126.041996] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.042098] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.042155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.042461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.042910] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.043034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.043077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.043313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.043313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.043406] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.062904] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1126.063114] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 1126.063231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.063374] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.063615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.063805] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.063918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.063980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.064156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.064240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.064332] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.386186] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.386186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.386186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.386186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.386186] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.386186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.386186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.386186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.386186] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.386838] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.387103] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.387309] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.387508] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.387718] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.387918] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.388180] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.410601] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.410601] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1126.410601] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.410601] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.410601] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.410601] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.410601] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.411091] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.411091] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba90d508-bdb2-4b66-9f5c-ab986fb0ce25',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.546573] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.546759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.546833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.547080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.547185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.547454] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.547570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.547636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.547819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.547925] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.548034] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 already deleted. [ 1126.548157] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.567559] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.913414] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.913840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.913840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.914023] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.914175] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.914325] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port ba90d508-bdb2-4b66-9f5c-ab986fb0ce25 not found, creating... [ 1126.914570] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.914726] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.914842] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.915078] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.915284] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.915670] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.915857] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.916055] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.916366] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.916554] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.916710] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: ba90d508-bdb2-4b66-9f5c-ab986fb0ce25 is going to be created. [ 1126.937992] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.937992] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.938270] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.939069] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.939069] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.939069] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.071428] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.574118] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.574598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.574598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.574720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.574760] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.574895] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1127.622786] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.623045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.623045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.623225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.623376] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.633278] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1127.676187] env[66364]: INFO networking_nsxv3.common.synchronization [req-d97a05e5-e777-4c61-a099-802b995d55bf req-2f8dee9d-436e-41ee-a4d3-2593bfffcd39 service nova] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_rules [ 1127.676429] env[66364]: INFO networking_nsxv3.common.synchronization [req-d97a05e5-e777-4c61-a099-802b995d55bf req-2f8dee9d-436e-41ee-a4d3-2593bfffcd39 service nova] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1127.676552] env[66364]: INFO networking_nsxv3.common.synchronization [req-d97a05e5-e777-4c61-a099-802b995d55bf req-2f8dee9d-436e-41ee-a4d3-2593bfffcd39 service nova] Enqueued Resource ID: ba90d508-bdb2-4b66-9f5c-ab986fb0ce25 with Priority: HIGHEST for action port [ 1127.677062] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_rules [ 1127.677902] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1127.677902] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba90d508-bdb2-4b66-9f5c-ab986fb0ce25 with Priority: HIGHEST for action port [ 1127.677902] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.677902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.677902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.677902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.678329] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.679163] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.679282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.679350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.679521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.680740] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.680740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.680740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.680740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.680740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.680740] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.681089] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.681089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.681089] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.681222] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.681222] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba90d508-bdb2-4b66-9f5c-ab986fb0ce25',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.821178] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1127.821396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.821575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.821803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.821995] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.822125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.822185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.822341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.822424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.822507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.822596] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.183109] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.183804] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.183804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.184121] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba90d508-bdb2-4b66-9f5c-ab986fb0ce25 with status ACTIVE [ 1128.184286] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.184415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.184482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.184750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.184845] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.185032] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.185119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.185204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.185355] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.185431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.185635] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.185755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.185858] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.186031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.186110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.186193] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba90d508-bdb2-4b66-9f5c-ab986fb0ce25 is going to be updated. [ 1128.211487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.212186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.212186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.212186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.212186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.212375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba90d508-bdb2-4b66-9f5c-ab986fb0ce25" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.324796] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.325029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.325029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.325415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.325578] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.325687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.325740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.325913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.326016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.326114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.326289] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.326385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.326488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.326594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.326728] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.326815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.326869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.327015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.327094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.327173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.327263] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.685352] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.829768] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c: rpc.has_security_group_logging(os_id): False [ 1128.848245] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.848475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.848475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.848645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.848740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.849060] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.849060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.849282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.849282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.849398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.849571] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.849684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.849750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.849851] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.849916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.850227] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.850227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.850380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.850380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.850479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.850537] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1128.915720] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.915921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.915921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.916154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.916318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.930369] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1129.135738] env[66364]: INFO networking_nsxv3.common.synchronization [req-22ef139d-f069-48ad-b2de-a3ea6b05e6fb req-02466621-6f7d-4365-81b6-0d430b683e51 tempest-ListImageFiltersTestJSON-1648004635 tempest-ListImageFiltersTestJSON-1648004635-project-member] Enqueued Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1129.136482] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1129.136868] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.136940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.137029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.137246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.137415] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.137527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.137589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.137813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.137872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.137914] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.188294] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.188294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.188649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.188649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.188732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.188777] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 is going to be created. [ 1129.230736] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.230946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.230994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.231296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.231497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.244691] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: UNINITIALIZED for 2s [ 1129.640800] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.643613] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1129.643812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.643962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.644212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.644418] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.644535] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.644600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.644767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.644847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.644930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.645033] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.143538] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.148254] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.148254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.148254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.148254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.148494] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.148494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.148494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.148592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.148701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.148749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.148895] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.148985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.149058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.149212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.149349] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.149497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.149497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.149625] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.149695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.149768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.149846] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.636982] env[66364]: INFO networking_nsxv3.common.synchronization [req-f9961493-10cb-4d68-8328-20f53ecafc05 req-d5ba4e10-adce-4503-8b18-127c26463d8e tempest-AttachVolumeTestJSON-1194962639 tempest-AttachVolumeTestJSON-1194962639-project-member] Enqueued Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_members [ 1130.637963] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9733c7ac-eb57-4467-8d19-d151daebf568 with Priority: HIGHEST for action security_group_members [ 1130.638244] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9733c7ac-eb57-4467-8d19-d151daebf568 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.638410] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.638510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.638765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.639042] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.639172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.639273] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.639518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.639636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.639774] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9733c7ac-eb57-4467-8d19-d151daebf568',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.646037] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.646252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.646599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.646648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.646776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.646916] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ad2de4-2360-481d-804e-9be48864280c is going to be updated. [ 1130.653421] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e327b378-51f2-4bc5-8b1c-697b0302c4a5: rpc.has_security_group_logging(os_id): False [ 1130.673222] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.673521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.673590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.673811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.673901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.674117] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.674234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.674365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.674531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.674610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.674947] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.674947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.675041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.675241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.675330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.675519] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.675611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.675670] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.675810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.675883] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.675965] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1130.682323] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.682501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.682543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.682750] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.682905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.692216] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: IN_PROGRESS for 2s [ 1130.743863] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.744092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.744092] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.744860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.744860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.765450] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1130.946163] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1130.946461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.145010] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.145010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.145010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.145010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.169073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.169294] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.169422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.169485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.170154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.170154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.170154] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9733c7ac-eb57-4467-8d19-d151daebf568 is going to be updated. [ 1131.204498] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.204601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.204636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.204837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.204985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.217238] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9733c7ac-eb57-4467-8d19-d151daebf568 in Status: IN_PROGRESS for 2s [ 1131.256863] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: SUCCESS [ 1131.257741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.257741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.257741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.257931] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.257991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.258052] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.258259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.258347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.258443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.258554] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.395247] env[66364]: INFO networking_nsxv3.common.synchronization [None req-2df7b5de-071d-4c94-9840-b4027ed35ef3 tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: e794563d-10ff-46a7-af47-ec9be0e556de with Priority: HIGHEST for action security_group_rules [ 1131.395809] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e794563d-10ff-46a7-af47-ec9be0e556de with Priority: HIGHEST for action security_group_rules [ 1131.396744] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e794563d-10ff-46a7-af47-ec9be0e556de taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.396744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e794563d-10ff-46a7-af47-ec9be0e556de" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.396744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e794563d-10ff-46a7-af47-ec9be0e556de" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.396744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e794563d-10ff-46a7-af47-ec9be0e556de" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.396744] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e794563d-10ff-46a7-af47-ec9be0e556de',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.498271] env[66364]: INFO networking_nsxv3.common.synchronization [None req-383113af-dd8c-4e60-ad09-0d6cf512f7d9 tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: e794563d-10ff-46a7-af47-ec9be0e556de with Priority: HIGHEST for action security_group_rules [ 1131.498863] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e794563d-10ff-46a7-af47-ec9be0e556de with Priority: HIGHEST for action security_group_rules [ 1131.499092] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e794563d-10ff-46a7-af47-ec9be0e556de taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.499230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e794563d-10ff-46a7-af47-ec9be0e556de" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.760509] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.919279] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.919748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.919748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.919888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.919952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.920017] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e794563d-10ff-46a7-af47-ec9be0e556de already deleted. [ 1131.920130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e794563d-10ff-46a7-af47-ec9be0e556de" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.920320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e794563d-10ff-46a7-af47-ec9be0e556de" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.920524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e794563d-10ff-46a7-af47-ec9be0e556de" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.920619] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e794563d-10ff-46a7-af47-ec9be0e556de',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.263271] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2333e496-b7f8-4064-8233-f2513788fa94: rpc.has_security_group_logging(os_id): False [ 1132.283017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.283187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.283259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.283480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.283574] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.283829] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.283940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.283986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.284211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.284264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.284341] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 is going to be created. [ 1132.295440] env[66364]: INFO networking_nsxv3.common.synchronization [req-71013d2b-86bd-47db-90b7-9d6d367d2a54 req-a8756724-8ffe-4155-b7f5-3969cd2afdaf tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1132.296044] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1132.296367] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.296494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.296602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.296821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.297055] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.297200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.297266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.297439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.297543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.297642] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.350196] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.350343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.350413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.350621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.350794] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.365682] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: IN_PROGRESS for 2s [ 1132.444697] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.444883] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.444921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.445141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.445405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.445528] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e794563d-10ff-46a7-af47-ec9be0e556de already deleted. [ 1132.445635] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e794563d-10ff-46a7-af47-ec9be0e556de" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.703011] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: SUCCESS [ 1132.703350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.784667] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1132.784667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.800319] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.230133] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9733c7ac-eb57-4467-8d19-d151daebf568 in Status: SUCCESS [ 1133.230133] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9733c7ac-eb57-4467-8d19-d151daebf568 deletion is rescheduled due to dependency. [ 1133.230133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9733c7ac-eb57-4467-8d19-d151daebf568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.302418] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.810030] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.810030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.810030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.810030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.810030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.810030] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1133.838880] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.839050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.839117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.839378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.839526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.851067] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1134.378964] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: SUCCESS [ 1134.379241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.780262] env[66364]: INFO networking_nsxv3.common.synchronization [req-191ede90-428a-4b4c-b6b8-605f256c9e90 req-1e2eb43c-911d-48a6-a567-1ffc15287e50 tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1134.781296] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1134.781482] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.781482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.781610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.782163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.782163] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.782163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.782163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.784839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.784839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.784839] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.285164] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.285459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.285459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.285826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.285826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.285945] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.286058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.286120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.286292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.286938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.287097] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1135.320262] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.320413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.320469] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.320720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.320870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.330909] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1135.863718] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1135.863718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.341311] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1137.341720] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d deletion is rescheduled due to dependency. [ 1137.341720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.841553] env[66364]: INFO networking_nsxv3.common.synchronization [None req-a90f36a3-c8fb-4f61-8b5f-77d18288a800 tempest-AttachVolumeTestJSON-1194962639 tempest-AttachVolumeTestJSON-1194962639-project-member] Enqueued Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_rules [ 1137.842248] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_rules [ 1137.842583] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.842707] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.842789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.843081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.843144] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.919422] env[66364]: INFO networking_nsxv3.common.synchronization [None req-a697cf9d-8836-4df3-a810-b39562cd2401 tempest-AttachVolumeTestJSON-1194962639 tempest-AttachVolumeTestJSON-1194962639-project-member] Enqueued Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_rules [ 1137.919996] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_rules [ 1137.920339] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.920440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.049853] env[66364]: INFO networking_nsxv3.common.synchronization [req-86083ba0-2ffd-4d06-8043-793b15db9c07 req-3bc5bbbb-cc70-41d5-ba80-eb214bbc0625 tempest-ListImageFiltersTestJSON-1648004635 tempest-ListImageFiltersTestJSON-1648004635-project-member] Enqueued Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1138.049853] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0ad2de4-2360-481d-804e-9be48864280c with Priority: HIGHEST for action security_group_members [ 1138.049853] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0ad2de4-2360-481d-804e-9be48864280c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.049853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.049853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.049853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.050431] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.050431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.050431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.050431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.050431] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.050431] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0ad2de4-2360-481d-804e-9be48864280c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.368746] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.369153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.369153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.369248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.369285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.369359] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 already deleted. [ 1138.369451] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.369608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.369829] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.369913] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.555353] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.555530] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.555602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.555857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.556023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.556175] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.556271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.556328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.556500] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.556579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.556665] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ad2de4-2360-481d-804e-9be48864280c is going to be updated. [ 1138.587156] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.587499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.587499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.587630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.587785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.601372] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: IN_PROGRESS for 2s [ 1138.891152] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.891312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.891386] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.891606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.891693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.891792] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 already deleted. [ 1138.891873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.611902] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0ad2de4-2360-481d-804e-9be48864280c in Status: SUCCESS [ 1140.612274] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0ad2de4-2360-481d-804e-9be48864280c deletion is rescheduled due to dependency. [ 1140.612274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0ad2de4-2360-481d-804e-9be48864280c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.619060] env[66364]: INFO networking_nsxv3.common.synchronization [req-83d3d074-867e-433c-ab2d-1ad54577397c req-ecae60b3-e799-4025-a28e-8e0b1e9e55d0 tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1141.619060] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1141.619060] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.619060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.619060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.619485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.619485] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.619485] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.619595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.619704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.619751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.619814] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.953079] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.953407] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.953554] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.953885] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.954211] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.954380] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.954501] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.954744] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.954892] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.955122] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.955239] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.955462] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.955585] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.955713] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.955819] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.956013] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.031846] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.032010] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.076 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1142.032073] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.032245] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.032568] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-9619929a-2726-4e7e-9613-f8086448ee6f taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.032783] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-9619929a-2726-4e7e-9613-f8086448ee6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.032854] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-9619929a-2726-4e7e-9613-f8086448ee6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.033206] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-9619929a-2726-4e7e-9613-f8086448ee6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.033370] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9619929a-2726-4e7e-9613-f8086448ee6f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.122082] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.122082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.122495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.122804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.122950] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.123233] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.123414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.123487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.123657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.123736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.123823] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1142.150197] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.150197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.150197] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.150714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.150892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.161202] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1142.535630] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.535950] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.536094] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.536446] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.536672] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.536882] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 9619929a-2726-4e7e-9613-f8086448ee6f not found, creating... [ 1142.537225] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.537418] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.537538] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.537785] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.537924] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.538223] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.538376] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.538492] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.538702] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.538835] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.538969] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 9619929a-2726-4e7e-9613-f8086448ee6f is going to be created. [ 1142.561704] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.562020] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.562077] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.562401] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.562693] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.562970] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-9619929a-2726-4e7e-9613-f8086448ee6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.236063] env[66364]: INFO networking_nsxv3.common.synchronization [req-83d3d074-867e-433c-ab2d-1ad54577397c req-380843d2-05c0-476e-aa06-88455aff0c31 service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 1143.236063] env[66364]: INFO networking_nsxv3.common.synchronization [req-83d3d074-867e-433c-ab2d-1ad54577397c req-380843d2-05c0-476e-aa06-88455aff0c31 service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1143.236400] env[66364]: INFO networking_nsxv3.common.synchronization [req-83d3d074-867e-433c-ab2d-1ad54577397c req-380843d2-05c0-476e-aa06-88455aff0c31 service nova] Enqueued Resource ID: 9619929a-2726-4e7e-9613-f8086448ee6f with Priority: HIGHEST for action port [ 1143.236823] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 1143.236964] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1143.237215] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9619929a-2726-4e7e-9613-f8086448ee6f with Priority: HIGHEST for action port [ 1143.237528] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.237758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.237793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.237967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.238077] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.239329] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.239423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.239734] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-9619929a-2726-4e7e-9613-f8086448ee6f taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.239888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9619929a-2726-4e7e-9613-f8086448ee6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.239955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9619929a-2726-4e7e-9613-f8086448ee6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.240142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9619929a-2726-4e7e-9613-f8086448ee6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.240218] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9619929a-2726-4e7e-9613-f8086448ee6f',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.740468] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.740599] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.741967] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9619929a-2726-4e7e-9613-f8086448ee6f with status ACTIVE [ 1143.742165] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.742284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.742342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.742559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.742648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.742821] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.742918] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.742979] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.743147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.743224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.743553] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.743653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.743903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.743903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.743992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.743992] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9619929a-2726-4e7e-9613-f8086448ee6f is going to be updated. [ 1143.768866] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.769071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.769118] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.769310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.769448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.769602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9619929a-2726-4e7e-9613-f8086448ee6f" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.172343] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1144.172610] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d deletion is rescheduled due to dependency. [ 1144.172772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.173018] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.173313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.173567] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.173736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.173824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.174110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.174223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.174450] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.677125] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.179950] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.682197] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.682649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.682649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.682802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.682802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.684022] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1145.717264] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.717264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.717398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.717634] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.717700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.728441] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1147.742794] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1147.743162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.743213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.743688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.744580] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.744723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.744795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.745310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.745310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.745310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.745484] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.938149] env[66364]: INFO networking_nsxv3.common.synchronization [req-9dc2a7fa-cd5f-49fe-be96-a5eff408770f req-4f56e29b-5419-4957-9563-542a5741ae0e tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1147.938722] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1147.939085] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.939203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.939203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.939424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.939604] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.939912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.939912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.940114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.940114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.940298] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.247859] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.248088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.248298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.248579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.248761] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.248866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.248932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.249105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.249279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.249279] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.249434] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.249529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.249600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.249732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.249868] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.249959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.250029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.250171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.250248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.250329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.250422] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.283551] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.283813] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.283974] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.284335] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.284747] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.284973] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.285146] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.285504] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.285696] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.285958] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.286135] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.286389] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.286545] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.286734] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.286884] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.287071] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.306929] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.307103] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.307244] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.307417] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.307774] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-55fbaee8-0f1e-47dc-a26a-1121cb55a321 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.307983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-55fbaee8-0f1e-47dc-a26a-1121cb55a321" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.308134] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-55fbaee8-0f1e-47dc-a26a-1121cb55a321" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.308412] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-55fbaee8-0f1e-47dc-a26a-1121cb55a321" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.308566] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55fbaee8-0f1e-47dc-a26a-1121cb55a321',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.442386] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.752841] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b49ee1f8-75f0-4dc8-86a3-69683601a19d: rpc.has_security_group_logging(os_id): False [ 1148.777444] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.777704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.777759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.778041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.778142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.778434] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.778539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.778644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.778817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.778914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.779151] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.779259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.779321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.779484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.779560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.779773] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.779881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.779941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.780143] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.780226] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.780362] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1148.811253] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.811658] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.811844] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.812164] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.812355] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.812551] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 55fbaee8-0f1e-47dc-a26a-1121cb55a321 not found, creating... [ 1148.812866] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.813066] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.813233] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.813578] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.813740] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.814172] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.814413] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.814575] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.814846] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.814990] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.815164] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 55fbaee8-0f1e-47dc-a26a-1121cb55a321 is going to be created. [ 1148.840682] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.840962] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.841080] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.841389] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.841599] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.841829] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-55fbaee8-0f1e-47dc-a26a-1121cb55a321" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.849899] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.850109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.850109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.850345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.850495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.880520] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1148.944905] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.446720] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.446931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.447012] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.447276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.447942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.447942] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 is going to be updated. [ 1149.498479] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.498479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.498479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.498718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.498854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.512151] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: IN_PROGRESS for 2s [ 1149.657118] env[66364]: INFO networking_nsxv3.common.synchronization [req-9dc2a7fa-cd5f-49fe-be96-a5eff408770f req-22a071a2-3677-42f5-b524-aa170fa0526c service nova] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_rules [ 1149.657118] env[66364]: INFO networking_nsxv3.common.synchronization [req-9dc2a7fa-cd5f-49fe-be96-a5eff408770f req-22a071a2-3677-42f5-b524-aa170fa0526c service nova] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1149.657118] env[66364]: INFO networking_nsxv3.common.synchronization [req-9dc2a7fa-cd5f-49fe-be96-a5eff408770f req-22a071a2-3677-42f5-b524-aa170fa0526c service nova] Enqueued Resource ID: 55fbaee8-0f1e-47dc-a26a-1121cb55a321 with Priority: HIGHEST for action port [ 1149.657680] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_rules [ 1149.658083] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1149.658083] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55fbaee8-0f1e-47dc-a26a-1121cb55a321 with Priority: HIGHEST for action port [ 1149.658415] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.658588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.658763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.659154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.659205] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.660160] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.660223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.660403] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-55fbaee8-0f1e-47dc-a26a-1121cb55a321 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.660502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55fbaee8-0f1e-47dc-a26a-1121cb55a321" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.660566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55fbaee8-0f1e-47dc-a26a-1121cb55a321" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.660753] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55fbaee8-0f1e-47dc-a26a-1121cb55a321" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.660833] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55fbaee8-0f1e-47dc-a26a-1121cb55a321',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.163673] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.163905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.164064] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55fbaee8-0f1e-47dc-a26a-1121cb55a321 with status ACTIVE [ 1150.164266] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.164474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.164508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.164769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.164891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.165135] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.165190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.165285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.165538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.165645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.165856] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.165988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.166083] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.166241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.166335] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.166436] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55fbaee8-0f1e-47dc-a26a-1121cb55a321 is going to be updated. [ 1150.189333] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.189422] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.189473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.189764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.189907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.190086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55fbaee8-0f1e-47dc-a26a-1121cb55a321" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.897344] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1150.897562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.525167] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: SUCCESS [ 1151.525495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.525628] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.525836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.526042] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.526156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.526258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.526966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.526966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.527107] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.029804] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.531777] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.034304] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.034479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.034546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.034765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.034856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.034955] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 is going to be updated. [ 1153.064083] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.064247] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.064313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.064593] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.064714] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.073714] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: IN_PROGRESS for 2s [ 1154.224421] env[66364]: INFO networking_nsxv3.common.synchronization [req-817d84db-2e07-48be-92e4-6a1a331093b4 req-5e496508-f8ea-4d4d-bd1b-f908809e69a4 tempest-AttachVolumeShelveTestJSON-446961995 tempest-AttachVolumeShelveTestJSON-446961995-project-member] Enqueued Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_members [ 1154.224972] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d105259-6c05-4d26-aa23-5631556fbf46 with Priority: HIGHEST for action security_group_members [ 1154.225303] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d105259-6c05-4d26-aa23-5631556fbf46 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.225427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.225496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.225694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.225851] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.225990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.226036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.226159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.226244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.226363] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d105259-6c05-4d26-aa23-5631556fbf46',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.728481] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.728666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.728736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.729051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.729162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.729397] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.729572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.729683] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.729892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.729996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.730130] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d105259-6c05-4d26-aa23-5631556fbf46 is going to be updated. [ 1154.761268] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.761492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.761492] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.761754] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.761902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.773493] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: IN_PROGRESS for 2s [ 1154.864618] env[66364]: INFO networking_nsxv3.common.synchronization [req-b96f3555-9bd5-4f5f-a504-9a7b6643f532 req-b9124611-680e-471c-8ba1-fba423b52620 tempest-AttachVolumeTestJSON-1194962639 tempest-AttachVolumeTestJSON-1194962639-project-member] Enqueued Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_members [ 1154.865236] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_members [ 1154.865410] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-058d428d-1c40-48eb-bb28-f8d8263ffcf8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.865527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.865591] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.865847] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.866008] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.870495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.870595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.870773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.870865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.870964] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.085742] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: SUCCESS [ 1155.085742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.085742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.085742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.085742] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.085742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.085742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.085742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.085742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.085742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.085742] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.213968] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-975 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.214254] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-975" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.214838] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-975" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.215182] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-975" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.215489] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.215683] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.215869] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.216582] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.216582] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.216582] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.216767] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.216767] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.216942] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.217036] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.217171] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.217339] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.246815] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.247148] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1155.247148] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.247275] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-975" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.247862] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-436b7b81-3544-482b-bc48-eabd8d50024c taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.248217] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-436b7b81-3544-482b-bc48-eabd8d50024c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.248217] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-436b7b81-3544-482b-bc48-eabd8d50024c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.248628] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-436b7b81-3544-482b-bc48-eabd8d50024c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.248713] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('436b7b81-3544-482b-bc48-eabd8d50024c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.375500] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.375709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.375805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.375997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.376122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.376265] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.376491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.376491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.376585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.376671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.376740] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 already deleted. [ 1155.376836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.587498] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.750909] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.751264] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.751306] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.751580] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.751783] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.752010] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 436b7b81-3544-482b-bc48-eabd8d50024c not found, creating... [ 1155.752318] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.752480] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.752601] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.752837] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.753383] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.753383] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.753540] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.753597] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.753843] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.753983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.754160] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 436b7b81-3544-482b-bc48-eabd8d50024c is going to be created. [ 1155.776493] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.776706] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.776830] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.777136] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.777371] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.777593] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-436b7b81-3544-482b-bc48-eabd8d50024c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.090304] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2333e496-b7f8-4064-8233-f2513788fa94: rpc.has_security_group_logging(os_id): False [ 1156.109386] env[66364]: INFO networking_nsxv3.common.synchronization [req-6dd85ef8-9797-44f5-9717-0826d35064ce req-e21944db-611a-4450-8994-8581fc91c50d tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1156.110815] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.111014] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.111142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.111456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.111608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.112014] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.112185] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.112313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.112561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.112687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.112821] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 is going to be updated. [ 1156.115187] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1156.115979] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.116148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.116248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.116541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.116764] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.116908] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.117015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.117261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.117385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.117518] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.174471] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.174656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.174701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.174949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.175055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.195531] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: IN_PROGRESS for 2s [ 1156.506243] env[66364]: INFO networking_nsxv3.common.synchronization [req-b96f3555-9bd5-4f5f-a504-9a7b6643f532 req-e5fa53e6-46f9-460d-8e10-1641c507f60e service nova] Enqueued Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_rules [ 1156.506492] env[66364]: INFO networking_nsxv3.common.synchronization [req-b96f3555-9bd5-4f5f-a504-9a7b6643f532 req-e5fa53e6-46f9-460d-8e10-1641c507f60e service nova] Enqueued Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_members [ 1156.506616] env[66364]: INFO networking_nsxv3.common.synchronization [req-b96f3555-9bd5-4f5f-a504-9a7b6643f532 req-e5fa53e6-46f9-460d-8e10-1641c507f60e service nova] Enqueued Resource ID: 436b7b81-3544-482b-bc48-eabd8d50024c with Priority: HIGHEST for action port [ 1156.507240] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_rules [ 1156.507399] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_members [ 1156.507499] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 436b7b81-3544-482b-bc48-eabd8d50024c with Priority: HIGHEST for action port [ 1156.507809] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.507935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.507996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.512358] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.512456] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.513917] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-058d428d-1c40-48eb-bb28-f8d8263ffcf8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.514063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.514127] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.514319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.514516] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.514632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.514701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.514871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.514962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.520057] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.520057] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-436b7b81-3544-482b-bc48-eabd8d50024c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.520057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-436b7b81-3544-482b-bc48-eabd8d50024c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.520057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-436b7b81-3544-482b-bc48-eabd8d50024c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.520057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-436b7b81-3544-482b-bc48-eabd8d50024c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.520370] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('436b7b81-3544-482b-bc48-eabd8d50024c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.620135] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.620315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.620385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.620773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.620773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.621722] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.621722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.621722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.621722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.621722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.621722] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be updated. [ 1156.659994] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.660253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.660253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.660466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.660606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.670515] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: IN_PROGRESS for 2s [ 1156.785422] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d105259-6c05-4d26-aa23-5631556fbf46 in Status: SUCCESS [ 1156.785648] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d105259-6c05-4d26-aa23-5631556fbf46 deletion is rescheduled due to dependency. [ 1156.785762] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d105259-6c05-4d26-aa23-5631556fbf46" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.023331] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-058d428d-1c40-48eb-bb28-f8d8263ffcf8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.023331] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.023331] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.024507] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 436b7b81-3544-482b-bc48-eabd8d50024c with status ACTIVE [ 1157.024828] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.024926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.024926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.026163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.026163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.026163] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.026163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.026163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.026163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.026163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.026419] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.026419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.026494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.026601] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.026820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.026820] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 436b7b81-3544-482b-bc48-eabd8d50024c is going to be updated. [ 1157.055527] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.055728] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.055805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.056148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.056311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.056525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-436b7b81-3544-482b-bc48-eabd8d50024c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.373670] env[66364]: INFO networking_nsxv3.common.synchronization [req-0ba7edcc-06f3-42af-a723-d04712c6ac3e req-19bba05f-4470-4d02-99a6-7127a62a17e5 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1157.374469] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1157.374862] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.375021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.375126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.375394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.375577] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.375722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.375802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.376048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.376184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.376316] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.525969] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.828266] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.828266] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.828266] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.828711] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.829352] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.829594] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.829846] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.830294] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.830533] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.830862] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.831074] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.831310] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.831526] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.831744] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1157.831963] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.832216] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.870221] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.870448] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1157.870555] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.870785] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.871190] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.871400] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.871538] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.871900] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.872194] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e49c7d2f-cca2-4468-8e52-412f0a37ee5e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.878105] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.029808] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.029808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.029808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.030036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.030036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.030149] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 is going to be created. [ 1158.068626] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.068769] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.068825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.069372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.069372] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.083579] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 in Status: UNINITIALIZED for 2s [ 1158.211319] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: SUCCESS [ 1158.211540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.375101] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.375349] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.375505] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.375797] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.375959] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.376127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port e49c7d2f-cca2-4468-8e52-412f0a37ee5e not found, creating... [ 1158.376413] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.376633] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.376772] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.377014] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.377163] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.377453] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.377612] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.377768] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.377948] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.378095] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.378237] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: e49c7d2f-cca2-4468-8e52-412f0a37ee5e is going to be created. [ 1158.382029] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.402317] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.402546] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.402676] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.402952] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.403208] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.403428] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.682911] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 1158.683284] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a deletion is rescheduled due to dependency. [ 1158.688040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.885348] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.885548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.885667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.885940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.886045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.886153] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1158.915850] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.915994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.916077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.916298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.916449] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.925958] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1159.147269] env[66364]: INFO networking_nsxv3.common.synchronization [req-0ba7edcc-06f3-42af-a723-d04712c6ac3e req-6ec357c5-61dd-4c07-a510-8b4b38c21a6d service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1159.147269] env[66364]: INFO networking_nsxv3.common.synchronization [req-0ba7edcc-06f3-42af-a723-d04712c6ac3e req-6ec357c5-61dd-4c07-a510-8b4b38c21a6d service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1159.147269] env[66364]: INFO networking_nsxv3.common.synchronization [req-0ba7edcc-06f3-42af-a723-d04712c6ac3e req-6ec357c5-61dd-4c07-a510-8b4b38c21a6d service nova] Enqueued Resource ID: e49c7d2f-cca2-4468-8e52-412f0a37ee5e with Priority: HIGHEST for action port [ 1159.147814] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1159.147967] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1159.148083] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e49c7d2f-cca2-4468-8e52-412f0a37ee5e with Priority: HIGHEST for action port [ 1159.148356] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.148477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.148549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.149112] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.149112] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.149784] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.149912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.150088] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.150208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.150271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.151170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.151290] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e49c7d2f-cca2-4468-8e52-412f0a37ee5e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.484404] env[66364]: INFO networking_nsxv3.common.synchronization [None req-84054124-a366-4967-b99d-e3470d5497a1 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1159.484404] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1159.484599] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.484734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.484803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.485225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.485225] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.485426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.485426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.485669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.485669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.485782] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.653524] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.653768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.653869] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e49c7d2f-cca2-4468-8e52-412f0a37ee5e with status ACTIVE [ 1159.654080] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.654204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.654308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.654510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.654557] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.654727] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.654820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.654871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.655035] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.655107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.655282] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.655437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.655437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.655597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.655653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.655747] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e49c7d2f-cca2-4468-8e52-412f0a37ee5e is going to be updated. [ 1159.687031] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.687031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.687031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.687031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.687031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.687031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e49c7d2f-cca2-4468-8e52-412f0a37ee5e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.989733] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.989926] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.990010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.990357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.990433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.990646] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.990744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.990795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.990956] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.991044] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.991130] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1160.020055] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.020174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.020244] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.020639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.020871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.032402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1160.092027] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 in Status: SUCCESS [ 1160.092275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.092437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.092671] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.092858] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.092974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.093048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.093213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.093294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.093379] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.093481] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.596232] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.937917] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1160.938245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.938336] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.938529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.938718] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.938833] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.938898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.939062] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.939142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.939235] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.101078] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 058d428d-1c40-48eb-bb28-f8d8263ffcf8: rpc.has_security_group_logging(os_id): False [ 1161.119113] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.119338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.119338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.119520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.119608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.119865] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.120012] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.120064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.120176] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.120249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.120332] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 is going to be created. [ 1161.178420] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.178564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.178636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.178841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.179025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.190133] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 in Status: IN_PROGRESS for 2s [ 1161.442654] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.945337] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.044533] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1162.044533] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c deletion is rescheduled due to dependency. [ 1162.044533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.447835] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.448458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.448570] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.448929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.448929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.449213] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1162.479515] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.479515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.479515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.479515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.479515] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.489699] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1163.202931] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 in Status: SUCCESS [ 1163.203224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.485060] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1164.485618] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1164.501658] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1164.501882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.502065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.502296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.502492] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.502763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.502763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.502900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.502958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.503046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.503165] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.006325] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.006564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.006721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.007734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.007734] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.007734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.007734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.007734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.007734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.007734] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.008091] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.008091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.008091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.008198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.008324] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.008437] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.008502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.008649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.008747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.008840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.008958] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.511816] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c: rpc.has_security_group_logging(os_id): False [ 1165.530968] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.531211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.531294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.531454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.531546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.531789] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.531910] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.531996] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.532206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.532293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.532497] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.532618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.532709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.532859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.532935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.533198] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.533257] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.533310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.533445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.533520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.533615] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1165.633071] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.633304] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.633377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.633839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.633839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.651345] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1167.667352] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1167.667737] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.487015] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.487298] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1169.888473] env[66364]: INFO networking_nsxv3.common.synchronization [req-f19a17d8-2602-4d25-9f47-74100262159d req-4a6e5d91-7b2b-48e3-be22-60cc0b54cccd tempest-AttachVolumeNegativeTest-995687773 tempest-AttachVolumeNegativeTest-995687773-project-member] Enqueued Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_members [ 1169.889204] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGHEST for action security_group_members [ 1169.889337] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b30b154-6212-47c2-a13c-f42428185a75 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.889467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.889558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.890032] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.890032] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.890152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.890152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.890326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.890602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.890602] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.392677] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.392909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.393034] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.393289] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.393289] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.393546] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.393636] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.393684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.394741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.394741] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.394741] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b30b154-6212-47c2-a13c-f42428185a75 is going to be updated. [ 1170.429296] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.429446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.429525] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.429758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.429917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.440870] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b30b154-6212-47c2-a13c-f42428185a75 in Status: IN_PROGRESS for 2s [ 1171.104349] env[66364]: INFO networking_nsxv3.common.synchronization [req-e56ee141-c0ed-4d28-b12b-5816e322f981 req-ca753e62-9363-4650-a9ce-32d56687c2c4 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1171.104762] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1171.105113] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.105277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.105375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.105518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.105750] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.105885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.105885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.106058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.106134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.106206] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.609248] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.111616] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.452940] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b30b154-6212-47c2-a13c-f42428185a75 in Status: SUCCESS [ 1172.453240] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b30b154-6212-47c2-a13c-f42428185a75 deletion is rescheduled due to dependency. [ 1172.453423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.463022] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.463219] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.463366] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.463652] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.463914] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.464081] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.464197] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.464408] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.464556] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.464765] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.464877] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.464982] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.465101] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.465209] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.465312] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.465440] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.486095] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.486275] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1172.486418] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.486606] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.486927] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.487130] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.487251] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.487578] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.487720] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457b99b9-32c5-4bb4-a4e6-e1a791f4be18',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.613978] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.614146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.614243] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.614495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.614604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.614716] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1172.643359] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.643526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.643580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.643838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.643986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.653461] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1172.990659] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.990900] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.991038] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.991333] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.991485] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.991634] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 not found, creating... [ 1172.991887] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.992059] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.992177] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.992398] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.992529] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.992802] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.992953] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.993081] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.993284] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.993460] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.993610] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 is going to be created. [ 1173.015900] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.016142] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.016226] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.016542] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.016808] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.017042] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.730989] env[66364]: INFO networking_nsxv3.common.synchronization [req-4434a37d-cf68-425f-b810-071004097242 req-b5dd134e-7473-4866-ade8-19d3385547ac service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 1173.731250] env[66364]: INFO networking_nsxv3.common.synchronization [req-4434a37d-cf68-425f-b810-071004097242 req-b5dd134e-7473-4866-ade8-19d3385547ac service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1173.731351] env[66364]: INFO networking_nsxv3.common.synchronization [req-4434a37d-cf68-425f-b810-071004097242 req-b5dd134e-7473-4866-ade8-19d3385547ac service nova] Enqueued Resource ID: 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 with Priority: HIGHEST for action port [ 1173.731552] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 1173.731660] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1173.731753] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 with Priority: HIGHEST for action port [ 1173.732331] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.732455] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.732524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.732727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.732804] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.733650] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.733782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.733820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.733980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.734147] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.734230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.734285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.734423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.734512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.734584] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.735299] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.735402] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.735507] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.735809] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.735809] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457b99b9-32c5-4bb4-a4e6-e1a791f4be18',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.238265] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.240036] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.240036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.240036] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 with status ACTIVE [ 1174.240274] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.241860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.241951] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.242165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.242252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.242427] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.242524] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.242842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.243068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.243180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.243414] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.244344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.244447] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.244704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.244704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.244818] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 is going to be updated. [ 1174.264847] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.265072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.265123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.265359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.265589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.265824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.663858] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1174.664134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.740786] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.868961] env[66364]: INFO networking_nsxv3.common.synchronization [req-891bdcbb-df58-44a6-b322-ed67f7bf83d6 req-dce37e78-118f-44bc-aa0c-a60624864736 tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1174.869530] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1174.869816] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.869964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.870154] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.870418] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.870534] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.870637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.870700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.870846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.870929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.871030] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.242730] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.242924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.242966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.243187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.243281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.243372] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1175.271676] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.271817] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.271901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.272117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.272261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.282363] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1175.323094] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.323252] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.323300] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.323891] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.323891] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.324143] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.324143] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.324370] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.324532] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.325284] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.325284] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.325284] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.325284] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.325497] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.325537] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.326039] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.354274] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.354530] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.354601] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.354781] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.355106] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-81da26b5-7dc2-4057-90ca-ce2a2cef9254 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.355283] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-81da26b5-7dc2-4057-90ca-ce2a2cef9254" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.355440] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-81da26b5-7dc2-4057-90ca-ce2a2cef9254" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.356344] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-81da26b5-7dc2-4057-90ca-ce2a2cef9254" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.356344] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81da26b5-7dc2-4057-90ca-ce2a2cef9254',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.373032] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.373220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.373220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.373438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.373438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.373643] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.373748] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.373802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.374325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.374325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.374325] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be updated. [ 1175.406549] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.406799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.406799] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.410043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.410043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.420466] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: IN_PROGRESS for 2s [ 1175.858920] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.859387] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.859387] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.859638] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.859796] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.859978] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 81da26b5-7dc2-4057-90ca-ce2a2cef9254 not found, creating... [ 1175.860297] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.860472] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.860591] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.860853] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.861027] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.861346] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.861507] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.861639] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.861890] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.862040] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.862206] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 81da26b5-7dc2-4057-90ca-ce2a2cef9254 is going to be created. [ 1175.885115] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.885360] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.885449] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.885777] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.885999] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.886249] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-81da26b5-7dc2-4057-90ca-ce2a2cef9254" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.299834] env[66364]: INFO networking_nsxv3.common.synchronization [req-1781748d-d8b7-48bc-9ca0-19802daf06be req-92b18817-bbd4-46c3-be98-611e4dab9605 tempest-DeleteServersTestJSON-268181847 tempest-DeleteServersTestJSON-268181847-project-member] Enqueued Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1176.300771] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 with Priority: HIGHEST for action security_group_members [ 1176.300771] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-e327b378-51f2-4bc5-8b1c-697b0302c4a5 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.301114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.301114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.301232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.301298] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.301396] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.301454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.301604] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.301682] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.301777] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e327b378-51f2-4bc5-8b1c-697b0302c4a5',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.656016] env[66364]: INFO networking_nsxv3.common.synchronization [req-891bdcbb-df58-44a6-b322-ed67f7bf83d6 req-665de76e-de68-4150-bc7e-237cd46e848f service nova] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 1176.656016] env[66364]: INFO networking_nsxv3.common.synchronization [req-891bdcbb-df58-44a6-b322-ed67f7bf83d6 req-665de76e-de68-4150-bc7e-237cd46e848f service nova] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1176.656016] env[66364]: INFO networking_nsxv3.common.synchronization [req-891bdcbb-df58-44a6-b322-ed67f7bf83d6 req-665de76e-de68-4150-bc7e-237cd46e848f service nova] Enqueued Resource ID: 81da26b5-7dc2-4057-90ca-ce2a2cef9254 with Priority: HIGHEST for action port [ 1176.656016] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 1176.656016] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1176.656016] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81da26b5-7dc2-4057-90ca-ce2a2cef9254 with Priority: HIGHEST for action port [ 1176.656016] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.656016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.656016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.656016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.656016] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.657573] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.657573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.657573] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-81da26b5-7dc2-4057-90ca-ce2a2cef9254 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.657573] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81da26b5-7dc2-4057-90ca-ce2a2cef9254" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.658198] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81da26b5-7dc2-4057-90ca-ce2a2cef9254" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.658343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81da26b5-7dc2-4057-90ca-ce2a2cef9254" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.658488] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81da26b5-7dc2-4057-90ca-ce2a2cef9254',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.804122] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.804122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.804122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.804428] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.804587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.804807] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.804907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.804962] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.805187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.805264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.805395] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 is going to be updated. [ 1176.837300] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.837617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.837716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.837997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.838721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.848892] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: IN_PROGRESS for 2s [ 1177.160952] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.160952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.161837] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81da26b5-7dc2-4057-90ca-ce2a2cef9254 with status ACTIVE [ 1177.161837] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.161837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.161837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.161837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.161837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.162051] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.162051] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.162124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.162781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.162781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.162781] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.162781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.162781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.162985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.162985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.163067] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81da26b5-7dc2-4057-90ca-ce2a2cef9254 is going to be updated. [ 1177.190239] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.190442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.190442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.190729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.190900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.191111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81da26b5-7dc2-4057-90ca-ce2a2cef9254" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.294214] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1177.295043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.295043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.295043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.295429] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.295429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.295429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.295429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.295642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.295642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.295699] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.432400] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 1177.432595] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a deletion is rescheduled due to dependency. [ 1177.432642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.432874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.433155] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.433378] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.433629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.433742] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.433931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.434042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.434147] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.797800] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.797985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.798038] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.798288] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.798430] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.798550] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.798610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.798757] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.799476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.799476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.799476] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.799476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.799476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.799476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.799476] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.799772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.799772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.799772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.799865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.799897] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.799968] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.937103] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.302241] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 622b5ca5-0010-4122-b9d4-901a52d1aa5c: rpc.has_security_group_logging(os_id): False [ 1178.325681] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.326091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.326091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.326240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.326274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.326903] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.326903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.326903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.326903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.326903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.327268] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.327268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.327268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.327377] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.327405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.327612] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.327702] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.327781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.328029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.328180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.328232] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1178.395594] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.395877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.395877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.396093] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.396310] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.414077] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1178.440533] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.859305] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 in Status: SUCCESS [ 1178.859453] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e327b378-51f2-4bc5-8b1c-697b0302c4a5 deletion is rescheduled due to dependency. [ 1178.859542] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e327b378-51f2-4bc5-8b1c-697b0302c4a5" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.944459] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.944872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.944872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.945160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.945311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.945471] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be updated. [ 1178.974957] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.974957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.974957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.974957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.974957] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.986612] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: IN_PROGRESS for 2s [ 1180.437047] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1180.437047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.998090] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 1180.998322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.998546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.998770] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.998967] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.999106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.999163] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.999323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.999398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.999483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.999598] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.502431] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.637496] env[66364]: INFO networking_nsxv3.common.synchronization [req-b6c7fa7f-c6b2-498d-b6e6-52c3f10583f9 req-527c081e-6c52-42fd-97cf-618a284413a7 tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 1181.638575] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 1181.638575] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.638575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.638850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.639169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.639386] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.639509] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.639605] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.639822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.639928] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.640085] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.004741] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5028084e-cee8-4d90-822e-92c0b2a9224a: rpc.has_security_group_logging(os_id): False [ 1182.025793] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.026022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.026022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.028122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.028122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.028122] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.028122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.028122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.028122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.028122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.028122] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be updated. [ 1182.086824] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.087021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.087063] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.087496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.087496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.099396] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: IN_PROGRESS for 2s [ 1182.142045] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.644633] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.151687] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.151687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.151687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.151687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.151687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.151687] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be updated. [ 1183.179213] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.179359] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.179463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.179694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.179842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.196264] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: IN_PROGRESS for 2s [ 1183.481352] env[66364]: INFO networking_nsxv3.common.synchronization [req-acbc643e-724e-4ae2-9147-051fa54eb4cc req-b9b2ded3-caaa-44ba-a72a-1046cbf6e24b tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1183.482396] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1183.482742] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.482895] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.482976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.483181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.483361] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.483718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.483718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.483718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.483971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.483971] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.963081] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.963571] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.963571] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.964194] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.964565] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.964829] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.965016] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.965413] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.965596] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.966085] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.966085] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.966085] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.966220] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.966407] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.966558] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.968049] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.986791] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.992601] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.992807] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1183.992960] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.993163] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.993498] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.993697] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.993816] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.994174] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.994314] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('802e4e7f-e48e-467e-a7f0-1d6d6976f7b6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.113041] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 1184.113184] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.489293] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.496907] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.497152] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.497278] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.497555] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.497704] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.497912] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 802e4e7f-e48e-467e-a7f0-1d6d6976f7b6 not found, creating... [ 1184.498308] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.498486] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.498610] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.498946] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.499048] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.499349] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.499509] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.499636] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.499853] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.499991] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.500152] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 802e4e7f-e48e-467e-a7f0-1d6d6976f7b6 is going to be created. [ 1184.521710] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.521880] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.521996] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.522345] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.522726] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.523101] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.991498] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.991868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.991868] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.994019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.994019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.994019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1185.025572] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.025572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.025572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.025572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.025572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.053034] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1185.206571] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: SUCCESS [ 1185.206816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.249730] env[66364]: INFO networking_nsxv3.common.synchronization [req-acbc643e-724e-4ae2-9147-051fa54eb4cc req-98c6f39c-6f6b-457d-a991-f378d5e2bd54 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1185.249899] env[66364]: INFO networking_nsxv3.common.synchronization [req-acbc643e-724e-4ae2-9147-051fa54eb4cc req-98c6f39c-6f6b-457d-a991-f378d5e2bd54 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1185.250049] env[66364]: INFO networking_nsxv3.common.synchronization [req-acbc643e-724e-4ae2-9147-051fa54eb4cc req-98c6f39c-6f6b-457d-a991-f378d5e2bd54 service nova] Enqueued Resource ID: 802e4e7f-e48e-467e-a7f0-1d6d6976f7b6 with Priority: HIGHEST for action port [ 1185.250594] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1185.250723] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1185.250812] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802e4e7f-e48e-467e-a7f0-1d6d6976f7b6 with Priority: HIGHEST for action port [ 1185.251347] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.251466] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.251529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.252301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.252301] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.253406] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.255812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.255812] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.255812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.255812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.255812] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.255812] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('802e4e7f-e48e-467e-a7f0-1d6d6976f7b6',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.754052] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.754259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.757179] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 802e4e7f-e48e-467e-a7f0-1d6d6976f7b6 with status ACTIVE [ 1185.757179] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.757179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.757179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.757425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.757504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.757698] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.757768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.757872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.758652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.758652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.758652] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.758652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.758652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.758652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.758652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.758652] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 802e4e7f-e48e-467e-a7f0-1d6d6976f7b6 is going to be updated. [ 1185.782065] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.782227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.782285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.782549] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.782654] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.782816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-802e4e7f-e48e-467e-a7f0-1d6d6976f7b6" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.063135] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1187.065893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.065893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.065893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.065893] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.065893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.065893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.065893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.065893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.065893] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.573012] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.076657] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.582652] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.582652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.582652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.582652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.582652] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.582652] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1188.629641] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.630045] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.630180] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.630407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.630580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.643835] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1190.252064] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.252490] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1190.653943] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1190.654179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.654339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.654556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.654748] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.654877] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.654916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.655090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.655172] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.655254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.655340] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.158546] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.160021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.160021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.160021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.160021] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.160021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.160021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.160021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.160021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.160021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.160389] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.160389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.160389] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.160630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.160846] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.160997] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.161108] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.161315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.161448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.161576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.161715] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.664387] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c: rpc.has_security_group_logging(os_id): False [ 1191.683620] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.683824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.683824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.684047] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.684140] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.684412] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.684538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.684538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.684681] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.684759] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.684943] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.685054] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.685191] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.685259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.685332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.685506] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.685629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.685677] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.685819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.685893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.685977] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1191.747587] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.747587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.747587] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.747731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.747811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.764993] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1191.861312] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.861547] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.861697] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.862046] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.862351] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.862555] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.862696] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.862985] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.863191] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.863442] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.863637] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.863761] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.863887] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.864028] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.864178] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.864338] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.888631] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.888802] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.888913] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.889108] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-844" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.889460] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.889584] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.889699] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.889966] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.890113] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457b99b9-32c5-4bb4-a4e6-e1a791f4be18',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.895381] env[66364]: INFO networking_nsxv3.common.synchronization [req-b45b6b76-f56b-4a43-92d7-7e78bcd761d2 req-3e3b2354-971a-4fb0-897c-d264daaa70f4 tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1191.895381] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1191.895690] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.895756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.895843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.896009] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.896300] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.896300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.896626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.896626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.896626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.896626] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.392279] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.392517] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.392641] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.392921] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.393084] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.393368] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.393525] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.393709] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.393945] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.394096] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.394373] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.394530] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.394634] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.394837] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.394962] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.395112] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 is going to be updated. [ 1192.398942] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.399113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.399208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.399420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.399522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.399756] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.399858] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.400782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.400782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.400782] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.400782] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1192.423890] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.424121] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.424246] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.424518] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.424713] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.424967] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.455168] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.455481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.455583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.456019] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.456195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.467156] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1193.109149] env[66364]: INFO networking_nsxv3.common.synchronization [req-fc58c453-b7ed-4706-9e60-43a97327f95a req-eb6681d9-ffd3-4189-9536-e7a69adb20f4 service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 1193.109149] env[66364]: INFO networking_nsxv3.common.synchronization [req-fc58c453-b7ed-4706-9e60-43a97327f95a req-eb6681d9-ffd3-4189-9536-e7a69adb20f4 service nova] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1193.109522] env[66364]: INFO networking_nsxv3.common.synchronization [req-fc58c453-b7ed-4706-9e60-43a97327f95a req-eb6681d9-ffd3-4189-9536-e7a69adb20f4 service nova] Enqueued Resource ID: 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 with Priority: HIGHEST for action port [ 1193.109580] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_rules [ 1193.109669] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1193.109762] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 with Priority: HIGHEST for action port [ 1193.110383] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.110497] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.110563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.110774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.110855] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.112378] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.112493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.112558] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.112731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.112883] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.112979] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.113055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.113203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.113287] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.113407] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.115352] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.115432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.115489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.116237] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.116237] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457b99b9-32c5-4bb4-a4e6-e1a791f4be18',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.613826] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.614084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.616425] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.617486] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 with status ACTIVE [ 1193.617700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.617828] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.617892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.618156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.618245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.618447] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.619124] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.619228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.619440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.619526] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.619731] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.619831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.619902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.620096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.620178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.620295] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 457b99b9-32c5-4bb4-a4e6-e1a791f4be18 is going to be updated. [ 1193.658270] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.658512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.658722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.659071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.659328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.659694] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-457b99b9-32c5-4bb4-a4e6-e1a791f4be18" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.781160] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1193.781385] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.122050] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.478404] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1194.478590] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d deletion is rescheduled due to dependency. [ 1194.478949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.624385] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.624660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.624660] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.624848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.624938] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.625092] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1194.654873] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.655049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.655105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.655328] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.655820] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.665222] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1196.677159] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1196.677478] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.677533] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.677731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.677920] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.678050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.678114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.678274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.678354] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.678436] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.678522] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.181124] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.181320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.181320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.181553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.181781] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.181899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.181973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.182106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.182246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.182298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.182415] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.182505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.182556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.182751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.183196] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.183196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.183196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.183463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.183463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.183556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.183598] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.686238] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 622b5ca5-0010-4122-b9d4-901a52d1aa5c: rpc.has_security_group_logging(os_id): False [ 1197.704061] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.704268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.704268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.704483] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.704571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.704760] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.704857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.704917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.705078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.705153] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.705331] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.705421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.705479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.705618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.705749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.705944] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.706048] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.706107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.706249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.706321] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.706405] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1197.766358] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.766505] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.766576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.766810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.767042] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.779758] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1198.110894] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1198.111079] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1199.159638] env[66364]: INFO networking_nsxv3.common.synchronization [req-881d1c25-86ad-45f6-9e6b-7ac35bcc38be req-23cf09d9-fe97-40d0-afc6-bc12f20268f9 tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1199.160243] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1199.160548] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.160666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.160738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.160924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.161229] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.161341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.161404] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.161554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.161629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.161725] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.480733] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.481549] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.481549] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.481549] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.481725] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.481725] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.481861] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.482352] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.482608] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.482877] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.483074] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.483440] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.483603] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.483803] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.483945] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.484163] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.502852] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.503124] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.503268] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.503464] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-563" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.503938] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-53146993-2766-4298-9727-484651ef8516 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.504144] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-53146993-2766-4298-9727-484651ef8516" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.504265] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-53146993-2766-4298-9727-484651ef8516" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.504575] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-53146993-2766-4298-9727-484651ef8516" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.504725] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53146993-2766-4298-9727-484651ef8516',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.665066] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.665066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.665066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.665066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.665066] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.665458] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.665458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.665458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.665617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.665924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.666081] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1199.707154] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.707390] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.707539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.707842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.708102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.722676] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1199.795861] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1199.796100] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.007884] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.008192] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.008298] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.008583] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.008859] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.009016] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 53146993-2766-4298-9727-484651ef8516 not found, creating... [ 1200.009290] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.009478] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.009600] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.011053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.011053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.011053] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.011053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.011053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.011053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.011053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.011411] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 53146993-2766-4298-9727-484651ef8516 is going to be created. [ 1200.033776] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.034035] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.034119] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.034404] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.034632] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.034859] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-53146993-2766-4298-9727-484651ef8516" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.868230] env[66364]: INFO networking_nsxv3.common.synchronization [req-881d1c25-86ad-45f6-9e6b-7ac35bcc38be req-129cf97f-c6ec-41ff-93d8-30829992700b service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 1200.868588] env[66364]: INFO networking_nsxv3.common.synchronization [req-881d1c25-86ad-45f6-9e6b-7ac35bcc38be req-129cf97f-c6ec-41ff-93d8-30829992700b service nova] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1200.868700] env[66364]: INFO networking_nsxv3.common.synchronization [req-881d1c25-86ad-45f6-9e6b-7ac35bcc38be req-129cf97f-c6ec-41ff-93d8-30829992700b service nova] Enqueued Resource ID: 53146993-2766-4298-9727-484651ef8516 with Priority: HIGHEST for action port [ 1200.869425] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_rules [ 1200.869599] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1200.869759] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53146993-2766-4298-9727-484651ef8516 with Priority: HIGHEST for action port [ 1200.870118] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.870275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.870373] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.870657] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.870786] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.872623] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.872623] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.873844] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-53146993-2766-4298-9727-484651ef8516 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.873844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53146993-2766-4298-9727-484651ef8516" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.873844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53146993-2766-4298-9727-484651ef8516" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.873844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53146993-2766-4298-9727-484651ef8516" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.873844] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53146993-2766-4298-9727-484651ef8516',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.372876] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.373060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.375476] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53146993-2766-4298-9727-484651ef8516 with status ACTIVE [ 1201.375818] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.376064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.376284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.376378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.376420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.376597] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.376738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.376850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.377119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.377119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.378028] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.378028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.378028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.378028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.378028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.378028] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53146993-2766-4298-9727-484651ef8516 is going to be updated. [ 1201.401843] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.401843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.401843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.401843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.401843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.401843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53146993-2766-4298-9727-484651ef8516" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.436259] env[66364]: INFO networking_nsxv3.common.synchronization [req-d7922d47-9c11-4ba7-9afe-bfb29d676190 req-44029d98-c1ba-4250-9696-1c0fee29bfcc tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1201.436831] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1201.437217] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.437343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.437408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.437612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.437917] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.437917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.437917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.438399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.438399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.438399] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.734296] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1201.734584] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d deletion is rescheduled due to dependency. [ 1201.734798] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.735144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.735458] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.735700] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.735896] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.736097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.736862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.736862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.736862] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.825882] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.825882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.825882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.825882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.825882] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.825882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.825882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.826184] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.826800] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.826800] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.826800] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.827107] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.827107] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.827256] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1201.827649] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.827649] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.849791] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.850059] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1201.850209] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.850421] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.852371] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-f604e5be-1529-4363-8bee-d7c717d2f295 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.852371] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-f604e5be-1529-4363-8bee-d7c717d2f295" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.852371] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-f604e5be-1529-4363-8bee-d7c717d2f295" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.852371] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-f604e5be-1529-4363-8bee-d7c717d2f295" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.852371] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f604e5be-1529-4363-8bee-d7c717d2f295',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.939991] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.238428] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.284725] env[66364]: INFO networking_nsxv3.common.synchronization [req-398a8493-d8e6-43de-b8a2-36f78b9f3c68 req-f207d573-6314-42ae-8c7d-7a8e638dba6e tempest-ServerActionsTestOtherA-556878168 tempest-ServerActionsTestOtherA-556878168-project-member] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 1202.285288] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGHEST for action security_group_members [ 1202.285793] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.285985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.286123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.286440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.286692] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.286864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.286976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.287264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.287393] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.287522] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.354787] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.355042] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.355178] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.355476] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.355625] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.355801] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port f604e5be-1529-4363-8bee-d7c717d2f295 not found, creating... [ 1202.356084] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.356244] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.356360] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.356621] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.356799] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.357141] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.357314] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.357430] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.357700] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.357840] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.357978] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: f604e5be-1529-4363-8bee-d7c717d2f295 is going to be created. [ 1202.379997] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.380221] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.380344] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.380610] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.380837] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.381076] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-f604e5be-1529-4363-8bee-d7c717d2f295" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.442518] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.740592] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.789883] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.790072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.790147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.790394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.790489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.790685] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.790783] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.790844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.790994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.791084] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.791169] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be updated. [ 1202.820217] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.820419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.820480] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.820672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.820844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.831874] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: IN_PROGRESS for 2s [ 1202.945190] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.945608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.945608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.945717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.945755] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.945874] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1202.976252] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.976475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.976475] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.976690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.976858] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.986378] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1203.081364] env[66364]: INFO networking_nsxv3.common.synchronization [req-d7922d47-9c11-4ba7-9afe-bfb29d676190 req-cf731d1a-f1c5-4ba3-b987-7fe010b78f66 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1203.081630] env[66364]: INFO networking_nsxv3.common.synchronization [req-d7922d47-9c11-4ba7-9afe-bfb29d676190 req-cf731d1a-f1c5-4ba3-b987-7fe010b78f66 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1203.081871] env[66364]: INFO networking_nsxv3.common.synchronization [req-d7922d47-9c11-4ba7-9afe-bfb29d676190 req-cf731d1a-f1c5-4ba3-b987-7fe010b78f66 service nova] Enqueued Resource ID: f604e5be-1529-4363-8bee-d7c717d2f295 with Priority: HIGHEST for action port [ 1203.086046] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1203.086206] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1203.086306] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f604e5be-1529-4363-8bee-d7c717d2f295 with Priority: HIGHEST for action port [ 1203.086996] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.087148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.087217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.087476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.087585] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.088527] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.088663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.088806] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-f604e5be-1529-4363-8bee-d7c717d2f295 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.088901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f604e5be-1529-4363-8bee-d7c717d2f295" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.088981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f604e5be-1529-4363-8bee-d7c717d2f295" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.089209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f604e5be-1529-4363-8bee-d7c717d2f295" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.089287] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f604e5be-1529-4363-8bee-d7c717d2f295',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.243087] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.243087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.243087] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.243423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.243423] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.243546] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1203.285773] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.286029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.286103] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.286384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.286624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.300713] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1203.591834] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.591983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.592135] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f604e5be-1529-4363-8bee-d7c717d2f295 with status ACTIVE [ 1203.592304] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.592424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.592488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.592700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.592791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.592960] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.593072] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.593132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.593300] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.593380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.593627] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.593819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.593949] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.594471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.594471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.594471] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f604e5be-1529-4363-8bee-d7c717d2f295 is going to be updated. [ 1203.656131] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.656378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.656378] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.656586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.656731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.656902] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f604e5be-1529-4363-8bee-d7c717d2f295" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.843363] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b in Status: SUCCESS [ 1204.843802] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b deletion is rescheduled due to dependency. [ 1204.843904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.000566] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1205.000891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.001194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.001651] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.001961] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.002181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.002293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.002595] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.002717] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.002840] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.312843] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1205.313102] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.313296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.313576] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.313797] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.313998] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.314069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.314213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.314323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.314427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.314576] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.505382] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.818143] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.818350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.818397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.818641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.818811] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.818931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.818994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.819225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.819325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.820166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.820352] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.820457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.820523] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.820676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.820823] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.820916] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.820977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.821141] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.821211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.821293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.821380] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.008700] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.323276] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b49ee1f8-75f0-4dc8-86a3-69683601a19d: rpc.has_security_group_logging(os_id): False [ 1206.341195] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.341391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.341452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.341665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.341765] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.342017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.342119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.342195] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.342351] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.342496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.342611] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.342705] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.342761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.342932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.343031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.343249] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.343357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.343420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.343561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.343646] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.343732] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1206.407831] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.408053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.408165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.408419] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.408508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.426040] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1206.510941] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.511147] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.511212] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.511427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.511560] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.511682] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1206.556971] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.557230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.557230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.557409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.557555] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.566882] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1207.605681] env[66364]: INFO networking_nsxv3.common.synchronization [req-e62aee9d-94ef-461d-a7d6-11bbd8f763c0 req-7768c5cf-e916-4b56-8228-f7dbfe1f9a94 tempest-ServerActionsTestOtherB-1668111998 tempest-ServerActionsTestOtherB-1668111998-project-member] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1207.606222] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1207.606581] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.606716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.606784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.606976] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.607138] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.607231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.607291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.607439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.607521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.607615] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.109633] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.109800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.109872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.110114] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.110305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.110413] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.110519] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.110580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.110740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.110819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.110903] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1208.138961] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.139152] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.139202] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.140119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.140119] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.153052] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1208.442709] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1208.442709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.579275] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1208.579649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.580023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.580272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.580739] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.580739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.580968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.581085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.581201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.581319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.581440] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.845571] env[66364]: INFO networking_nsxv3.common.synchronization [req-13ebd64c-53a8-4cec-b07f-c661f5497543 req-6e92cbe6-52f4-4e2f-94ff-59dc26167eae tempest-ServerRescueNegativeTestJSON-1330136755 tempest-ServerRescueNegativeTestJSON-1330136755-project-member] Enqueued Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_members [ 1208.845571] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df43df14-5db4-47e2-aec2-171f912259af with Priority: HIGHEST for action security_group_members [ 1208.845571] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-df43df14-5db4-47e2-aec2-171f912259af taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.845571] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.846259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.846259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.846259] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.846259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.846259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.846522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.846522] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.846522] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df43df14-5db4-47e2-aec2-171f912259af',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.084409] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.084594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.084669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.084892] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.085079] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.085174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.085234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.085380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.085470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.085554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.085697] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.086135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.086135] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.086233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.086461] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.086461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.086669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.086669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.086797] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.087452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.087452] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.348648] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.348813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.348873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.349126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.349349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.349418] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.349546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.349585] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.349709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.349790] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.349864] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df43df14-5db4-47e2-aec2-171f912259af is going to be updated. [ 1209.379072] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.379240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.379330] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.379501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.379642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.388638] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df43df14-5db4-47e2-aec2-171f912259af in Status: IN_PROGRESS for 2s [ 1209.590633] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c: rpc.has_security_group_logging(os_id): False [ 1209.610567] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.610567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.610567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.610567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.610567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.610567] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.610567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.610567] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.611403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.611403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.611403] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.611403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.611403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.611403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.611403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.611749] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.611749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.611749] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.611955] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.612609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.612722] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1209.734665] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.734665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.734665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.739122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.739122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.756671] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1210.141580] env[66364]: INFO networking_nsxv3.common.synchronization [req-e0660e55-0df2-4b8e-9a91-72d8f303f4f0 req-49b101c1-bc57-4ee9-8d24-0a2f06a6ca5c tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1210.142417] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1210.142605] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.142758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.142837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.143071] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.143247] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.143363] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.143420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.143649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.143767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.143883] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.166911] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1210.169989] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 deletion is rescheduled due to dependency. [ 1210.169989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.647672] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.149339] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.399110] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df43df14-5db4-47e2-aec2-171f912259af in Status: SUCCESS [ 1211.399281] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df43df14-5db4-47e2-aec2-171f912259af deletion is rescheduled due to dependency. [ 1211.399413] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df43df14-5db4-47e2-aec2-171f912259af" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.652176] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.652415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.652541] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.652914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.653126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.653251] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 is going to be updated. [ 1211.689837] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.689960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.690064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.690266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.690424] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.702214] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: IN_PROGRESS for 2s [ 1211.774843] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1211.775015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.838070] env[66364]: INFO networking_nsxv3.common.synchronization [None req-0ab4e851-fbc4-4ade-be7e-a388e2da3fd7 None None] Enqueued Resource ID: af5ce3a5-892f-447d-b5a6-7f33f50c2c89 with Priority: HIGHEST for action port [ 1211.838586] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5ce3a5-892f-447d-b5a6-7f33f50c2c89 with Priority: HIGHEST for action port [ 1211.838890] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-af5ce3a5-892f-447d-b5a6-7f33f50c2c89 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.839016] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af5ce3a5-892f-447d-b5a6-7f33f50c2c89" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.839085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af5ce3a5-892f-447d-b5a6-7f33f50c2c89" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.839347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af5ce3a5-892f-447d-b5a6-7f33f50c2c89" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.839472] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5ce3a5-892f-447d-b5a6-7f33f50c2c89',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.341817] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af5ce3a5-892f-447d-b5a6-7f33f50c2c89 [ 1212.342119] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.342246] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.342313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.342491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.342581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.342678] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af5ce3a5-892f-447d-b5a6-7f33f50c2c89 already deleted. [ 1212.344426] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af5ce3a5-892f-447d-b5a6-7f33f50c2c89" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.062340] env[66364]: INFO networking_nsxv3.common.synchronization [req-53bfbc35-8e93-4d55-bd02-3909e91dad31 req-5bbdd56e-6e8b-4d24-9812-706707379efc tempest-ServerDiskConfigTestJSON-542639808 tempest-ServerDiskConfigTestJSON-542639808-project-member] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1213.062956] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGHEST for action security_group_members [ 1213.063489] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.063489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.063630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.064647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.064647] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.064647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.064647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.064647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.064647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.064647] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.567411] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.567802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.567802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.567869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.567991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.568148] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.568260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.568360] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.568563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.568563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.568687] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be updated. [ 1213.602784] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.602981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.603190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.603457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.603659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.615328] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: IN_PROGRESS for 2s [ 1213.721967] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: SUCCESS [ 1213.721967] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.464591] env[66364]: INFO networking_nsxv3.common.synchronization [None req-3b8a48b5-34a7-4fae-90ba-ea1717d5f7a9 None None] Enqueued Resource ID: f30ee2f8-630e-40f6-9432-5ac6ba496976 with Priority: HIGHEST for action port [ 1214.465105] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f30ee2f8-630e-40f6-9432-5ac6ba496976 with Priority: HIGHEST for action port [ 1214.465470] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-f30ee2f8-630e-40f6-9432-5ac6ba496976 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.465611] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f30ee2f8-630e-40f6-9432-5ac6ba496976" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.465712] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f30ee2f8-630e-40f6-9432-5ac6ba496976" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.465994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f30ee2f8-630e-40f6-9432-5ac6ba496976" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.466888] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f30ee2f8-630e-40f6-9432-5ac6ba496976',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.492688] env[66364]: INFO networking_nsxv3.common.synchronization [req-93924bb5-1931-4d83-9a3e-090092ffe221 req-ebb3525f-9d6a-46aa-823f-233cc65df246 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1214.493390] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1214.493525] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.493649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.493713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.494125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.494125] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.494245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.494245] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.494409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.494456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.494542] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.968863] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f30ee2f8-630e-40f6-9432-5ac6ba496976 [ 1214.969188] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.969333] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.969401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.969632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.969724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.969819] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f30ee2f8-630e-40f6-9432-5ac6ba496976 already deleted. [ 1214.969909] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f30ee2f8-630e-40f6-9432-5ac6ba496976" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.996955] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.499183] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.625646] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d in Status: SUCCESS [ 1215.625646] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d deletion is rescheduled due to dependency. [ 1215.625864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.001680] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.002020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.002020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.002145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.002239] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.002336] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1216.058626] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.058716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.058716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.058943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.059101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.072033] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1218.084989] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1218.084989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.208458] env[66364]: INFO networking_nsxv3.common.synchronization [req-3c2072fc-26ee-43bc-a984-902f5fc9e789 req-121e09b2-21f7-42e3-957d-a7b28d09782a tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1218.209051] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGHEST for action security_group_members [ 1218.209521] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.209521] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.209665] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.210261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.210261] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.210261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.210261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.210261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.210261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.210556] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.713233] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.713520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.713520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.713722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.713854] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.714137] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.714274] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.714346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.714504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.714579] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.714700] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 is going to be updated. [ 1218.751680] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.752086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.752250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.752624] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.753208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.765922] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: IN_PROGRESS for 2s [ 1219.430260] env[66364]: INFO networking_nsxv3.common.synchronization [req-763499c5-4f4c-428d-a863-0d2adbcf18b6 req-87e9c156-d014-43e3-85d6-77724f545490 tempest-ServerMetadataNegativeTestJSON-1042290440 tempest-ServerMetadataNegativeTestJSON-1042290440-project-member] Enqueued Resource ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e with Priority: HIGHEST for action security_group_members [ 1219.430814] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e with Priority: HIGHEST for action security_group_members [ 1219.431139] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f7b3ef5-012b-41d3-8579-50da00ef550e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.431296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.431415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.431589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.431747] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.431846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.431915] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.432228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.432325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.432421] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f7b3ef5-012b-41d3-8579-50da00ef550e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.768989] env[66364]: INFO networking_nsxv3.common.synchronization [req-8fbb253f-673f-4ad6-8149-9e6f13cdfa7e req-d1c58ecd-f62a-4574-82e2-4cfcc5717a7b tempest-ServerRescueNegativeTestJSON-1330136755 tempest-ServerRescueNegativeTestJSON-1330136755-project-member] Enqueued Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1219.769656] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1219.770265] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.770265] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.770438] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.770566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.770763] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.770905] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.771064] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.771263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.771356] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.771449] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.846134] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.846134] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-200" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.846134] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-200" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.846312] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-200" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.846544] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.846709] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.846834] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.847304] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.847540] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.847799] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.848215] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.848380] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.848529] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.848691] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.848865] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.849049] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.872556] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.873434] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1219.873434] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.874032] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-200" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.874155] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-c7bc8115-da69-41ec-b4a0-60d9ab270782 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.874434] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-c7bc8115-da69-41ec-b4a0-60d9ab270782" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.874607] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-c7bc8115-da69-41ec-b4a0-60d9ab270782" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.875088] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-c7bc8115-da69-41ec-b4a0-60d9ab270782" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.875232] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7bc8115-da69-41ec-b4a0-60d9ab270782',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.934718] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.935232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.935356] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.935562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.936193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.936193] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.936193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.936193] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.936446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.936446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.936446] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e already deleted. [ 1219.936538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.275968] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.378845] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.378845] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.378845] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.379130] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.379231] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.379455] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port c7bc8115-da69-41ec-b4a0-60d9ab270782 not found, creating... [ 1220.379605] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.379768] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.379886] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.380982] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.380982] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.380982] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.380982] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.380982] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.380982] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.382037] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.382037] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: c7bc8115-da69-41ec-b4a0-60d9ab270782 is going to be created. [ 1220.403765] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.403980] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.405042] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.405042] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.405042] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.405042] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-c7bc8115-da69-41ec-b4a0-60d9ab270782" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.777126] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2333e496-b7f8-4064-8233-f2513788fa94 in Status: SUCCESS [ 1220.777126] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 deletion is rescheduled due to dependency. [ 1220.777538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.778629] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.135679] env[66364]: INFO networking_nsxv3.common.synchronization [req-763499c5-4f4c-428d-a863-0d2adbcf18b6 req-ae257207-fa1b-4d18-8e54-c6438308f9b5 service nova] Enqueued Resource ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e with Priority: HIGHEST for action security_group_rules [ 1221.135916] env[66364]: INFO networking_nsxv3.common.synchronization [req-763499c5-4f4c-428d-a863-0d2adbcf18b6 req-ae257207-fa1b-4d18-8e54-c6438308f9b5 service nova] Enqueued Resource ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e with Priority: HIGHEST for action security_group_members [ 1221.136103] env[66364]: INFO networking_nsxv3.common.synchronization [req-763499c5-4f4c-428d-a863-0d2adbcf18b6 req-ae257207-fa1b-4d18-8e54-c6438308f9b5 service nova] Enqueued Resource ID: c7bc8115-da69-41ec-b4a0-60d9ab270782 with Priority: HIGHEST for action port [ 1221.136670] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e with Priority: HIGHEST for action security_group_rules [ 1221.136809] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e with Priority: HIGHEST for action security_group_members [ 1221.136912] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7bc8115-da69-41ec-b4a0-60d9ab270782 with Priority: HIGHEST for action port [ 1221.137445] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f7b3ef5-012b-41d3-8579-50da00ef550e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.137603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.137701] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.137999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.138145] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f7b3ef5-012b-41d3-8579-50da00ef550e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.139191] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f7b3ef5-012b-41d3-8579-50da00ef550e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.139409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.139409] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.139664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.139857] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.139966] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.140189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.141227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.141227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.141227] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f7b3ef5-012b-41d3-8579-50da00ef550e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.141832] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7bc8115-da69-41ec-b4a0-60d9ab270782 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.141832] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7bc8115-da69-41ec-b4a0-60d9ab270782" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.141832] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7bc8115-da69-41ec-b4a0-60d9ab270782" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.141832] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7bc8115-da69-41ec-b4a0-60d9ab270782" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.142015] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7bc8115-da69-41ec-b4a0-60d9ab270782',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.281503] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.281718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.281767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.281968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.282075] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.282176] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 is going to be updated. [ 1221.309602] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.309751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.309821] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.310043] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.310233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.322956] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: IN_PROGRESS for 2s [ 1221.644564] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f7b3ef5-012b-41d3-8579-50da00ef550e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.645823] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f7b3ef5-012b-41d3-8579-50da00ef550e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.646091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.646339] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7bc8115-da69-41ec-b4a0-60d9ab270782 with status ACTIVE [ 1221.646339] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.646917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.646917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.646917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.646917] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.647164] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.647164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.647164] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.647318] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.647420] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.647575] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.647727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.647727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.647893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.648017] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.648072] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7bc8115-da69-41ec-b4a0-60d9ab270782 is going to be updated. [ 1221.673132] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.673448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.673448] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.673721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.673942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.674131] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7bc8115-da69-41ec-b4a0-60d9ab270782" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.150917] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f7b3ef5-012b-41d3-8579-50da00ef550e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.652941] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.653148] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.653251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.653444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.653535] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.653633] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e is going to be created. [ 1222.690751] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.691145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.691145] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.691291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.691384] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.703795] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e in Status: UNINITIALIZED for 2s [ 1223.345866] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: SUCCESS [ 1223.346264] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.447815] env[66364]: INFO networking_nsxv3.common.synchronization [req-36954843-a8c9-48ca-90b6-8a7058ac9e35 req-69b07116-1d61-4aa1-a4d8-fc83fc8b1696 tempest-ServerActionsTestOtherB-1668111998 tempest-ServerActionsTestOtherB-1668111998-project-member] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1224.448398] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1224.448768] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.448856] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.448924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.449142] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.449300] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.449399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.449460] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.449610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.449695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.449789] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.731019] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e in Status: SUCCESS [ 1224.731241] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.731395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.731632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.731852] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.731974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.732049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.732258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.732353] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.732442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.732533] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f7b3ef5-012b-41d3-8579-50da00ef550e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.869870] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.870152] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.870264] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.870856] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.870975] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.871157] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.871555] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.872044] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.872213] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.872470] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.872634] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.872748] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.872926] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.873098] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.873260] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.873411] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.899744] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.899959] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1224.900775] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.900775] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.900775] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-7e792c83-b4e8-4ca6-a117-a75234a4b104 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.900926] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.901044] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.901439] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.901583] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e792c83-b4e8-4ca6-a117-a75234a4b104',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.951762] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.952009] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.952111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.952365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.952520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.952825] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.952991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.953080] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.953303] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.953407] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.953561] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1224.984976] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.985166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.985219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.985414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.985559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.000733] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1225.235616] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f7b3ef5-012b-41d3-8579-50da00ef550e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.235806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.235879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.236144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.236313] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.236473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.236473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.236626] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.236713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.236875] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.236979] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f7b3ef5-012b-41d3-8579-50da00ef550e taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.237101] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.237160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.237305] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.237444] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.237535] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.237590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.237729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.237804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.237882] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.237969] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f7b3ef5-012b-41d3-8579-50da00ef550e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.404677] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.404898] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.405042] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.405356] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.405512] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.405669] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 7e792c83-b4e8-4ca6-a117-a75234a4b104 not found, creating... [ 1225.405963] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.406149] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.406276] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.406513] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.407269] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.407269] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.407269] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.407465] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.407598] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.407945] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.407945] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 7e792c83-b4e8-4ca6-a117-a75234a4b104 is going to be created. [ 1225.428443] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.428659] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.428766] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.429047] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.429276] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.429498] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.740826] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f7b3ef5-012b-41d3-8579-50da00ef550e: rpc.has_security_group_logging(os_id): False [ 1225.794500] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.794716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.794716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.794960] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.795107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.795319] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.795719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.795719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.795719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.795719] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.795974] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.796085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.796159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.796306] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.796391] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.796599] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.796899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.796899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.797023] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.797060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.797138] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e is going to be created. [ 1225.877407] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.879375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.879375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.879375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.879375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.894469] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e in Status: IN_PROGRESS for 2s [ 1226.153781] env[66364]: INFO networking_nsxv3.common.synchronization [req-36954843-a8c9-48ca-90b6-8a7058ac9e35 req-e1a4073b-72ad-4b49-ad02-5265f52a0231 service nova] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 1226.154109] env[66364]: INFO networking_nsxv3.common.synchronization [req-36954843-a8c9-48ca-90b6-8a7058ac9e35 req-e1a4073b-72ad-4b49-ad02-5265f52a0231 service nova] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1226.154172] env[66364]: INFO networking_nsxv3.common.synchronization [req-36954843-a8c9-48ca-90b6-8a7058ac9e35 req-e1a4073b-72ad-4b49-ad02-5265f52a0231 service nova] Enqueued Resource ID: 7e792c83-b4e8-4ca6-a117-a75234a4b104 with Priority: HIGHEST for action port [ 1226.154805] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 1226.154950] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1226.155087] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e792c83-b4e8-4ca6-a117-a75234a4b104 with Priority: HIGHEST for action port [ 1226.155811] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.156040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.156040] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.156188] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.156262] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.157225] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.157324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.157547] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e792c83-b4e8-4ca6-a117-a75234a4b104 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.157630] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.157674] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.158085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.158085] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e792c83-b4e8-4ca6-a117-a75234a4b104',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.660908] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.661122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.661314] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e792c83-b4e8-4ca6-a117-a75234a4b104 with status ACTIVE [ 1226.661425] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.661569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.661667] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.661971] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.662078] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.662255] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.662352] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.662403] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.662564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.662639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.662818] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.662941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.662982] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.663106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.663174] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.663257] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e792c83-b4e8-4ca6-a117-a75234a4b104 is going to be updated. [ 1226.686453] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.686617] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.686673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.686874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.687022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.687186] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.011766] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1227.012136] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 deletion is rescheduled due to dependency. [ 1227.012136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.012227] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.012467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.012671] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.012789] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.012853] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.013029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.013110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.013205] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.516129] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.875749] env[66364]: INFO networking_nsxv3.common.synchronization [req-6097dd75-a3d4-48d8-a7ac-2fdbd264918f req-aad6e435-2bd1-4e27-b616-a86b0c5bcdc2 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1227.875749] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1227.876093] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.876216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.876278] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.876758] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.876873] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.876987] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.877058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.878123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.878123] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.878123] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.912939] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e in Status: SUCCESS [ 1227.913199] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.019032] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.380263] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.521599] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.521764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.521842] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.522073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.522169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.522267] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1228.561686] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.561850] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.561981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.562134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.562282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.573346] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1228.883327] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.386239] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.386598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.386598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.386739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.386879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.387042] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1229.419829] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.420166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.420166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.420320] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.420375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.430992] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1230.584148] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1230.584467] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.584663] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.584968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.585270] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.585412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.585561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.585730] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.585832] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.586037] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.586161] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.088602] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.322250] env[66364]: INFO networking_nsxv3.common.synchronization [None req-1f0ffafe-ae10-49a6-a6b3-b7bcaf8b6ea8 tempest-AttachInterfacesTestJSON-99035396 tempest-AttachInterfacesTestJSON-99035396-project-member] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1231.322803] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGHEST for action security_group_members [ 1231.323152] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.323281] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.323344] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.323547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.323986] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.323986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.323986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.324214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.324214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.324214] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.443097] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1231.443097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.592176] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85f93bd5-5dca-472e-a30a-fd77d873bad8: rpc.has_security_group_logging(os_id): False [ 1231.609715] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.609913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.609913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.610175] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.610298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.610771] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.610771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.610771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.611022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.611022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.611022] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1231.683022] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.683211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.683211] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.683414] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.683527] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.701987] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1231.826711] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.826990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.826990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.827292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.827394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.827635] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.827825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.827914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.828083] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.828187] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.828328] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be updated. [ 1231.975041] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.975252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.975252] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.975494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.975669] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.986221] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: IN_PROGRESS for 2s [ 1232.578566] env[66364]: INFO networking_nsxv3.common.synchronization [req-8bf7ba8a-1dc6-4c35-97fb-0ce1b12734e3 req-c0d861f0-d1c5-41fe-918d-eae6f86303b7 tempest-ServerMetadataNegativeTestJSON-1042290440 tempest-ServerMetadataNegativeTestJSON-1042290440-project-member] Enqueued Resource ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e with Priority: HIGHEST for action security_group_members [ 1232.579684] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e with Priority: HIGHEST for action security_group_members [ 1232.579933] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f7b3ef5-012b-41d3-8579-50da00ef550e taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.580095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.580160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.580421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.580566] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.580690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.580690] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.580843] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.580930] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.581039] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f7b3ef5-012b-41d3-8579-50da00ef550e',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.083035] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.083338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.083338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.083488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.083578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.083773] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.083927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.083927] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.084091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.084169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.084253] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e is going to be updated. [ 1233.117810] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.118228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.118228] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.118477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.118720] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.129464] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e in Status: IN_PROGRESS for 2s [ 1233.716160] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1233.716342] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.998232] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c in Status: SUCCESS [ 1233.998232] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c deletion is rescheduled due to dependency. [ 1233.998232] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.140473] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e in Status: SUCCESS [ 1235.140769] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f7b3ef5-012b-41d3-8579-50da00ef550e deletion is rescheduled due to dependency. [ 1235.140941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f7b3ef5-012b-41d3-8579-50da00ef550e" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.241774] env[66364]: INFO networking_nsxv3.common.synchronization [req-56b77b61-ad55-4ba9-810d-4d3942fde947 req-b457c880-e0d2-4833-acaf-be237fc6c436 tempest-ServerRescueNegativeTestJSON-1330136755 tempest-ServerRescueNegativeTestJSON-1330136755-project-member] Enqueued Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1235.241774] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGHEST for action security_group_members [ 1235.241774] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.241774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.242287] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.242723] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.243056] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.243349] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.243552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.243841] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.244061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.245378] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.747038] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.747271] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.747341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.747602] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.747709] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.747950] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.748106] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.748170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.748365] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.748487] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.748536] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 is going to be updated. [ 1235.751593] env[66364]: INFO networking_nsxv3.common.synchronization [req-8a107a23-1bf8-49bb-8a1e-6d415b46128d req-7727f21c-1fde-4831-a70e-3f50befc2bfe tempest-AttachVolumeTestJSON-1194962639 tempest-AttachVolumeTestJSON-1194962639-project-member] Enqueued Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_members [ 1235.752708] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGHEST for action security_group_members [ 1235.753085] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-058d428d-1c40-48eb-bb28-f8d8263ffcf8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.753221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.753292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.753510] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.753675] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.753775] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.753836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.753992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.754094] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.754194] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.787223] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.787491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.787491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.787995] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.788206] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.802211] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: IN_PROGRESS for 2s [ 1236.257320] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.257614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.257614] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.257791] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.257881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.258120] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.258229] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.258293] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.258450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.258528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.258614] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 is going to be updated. [ 1236.308668] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.308668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.308668] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.308906] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.309055] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.322058] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 in Status: IN_PROGRESS for 2s [ 1237.812418] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 in Status: SUCCESS [ 1237.812688] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 deletion is rescheduled due to dependency. [ 1237.812726] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.334027] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 in Status: SUCCESS [ 1238.334290] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 deletion is rescheduled due to dependency. [ 1238.334405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.753893] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.753893] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1245.755277] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1245.755645] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1246.220762] env[66364]: INFO networking_nsxv3.common.synchronization [req-0dabd785-0447-49ee-932d-0648be03d265 req-cd4627e2-a599-42ed-9bce-5fbc7cf64c02 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1246.221620] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1246.222368] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.222368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.222368] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.222514] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.222667] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.226025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.226025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.226025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.226025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.226025] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.524934] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.525148] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.525273] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.525588] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.525850] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.526066] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.526200] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.526418] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.526562] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.526770] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.526879] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.526989] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.527156] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.527271] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.527377] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.527505] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.552806] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.553029] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1246.553113] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.553295] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.553617] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-b81d2b58-2861-4e14-8c5d-17ce60427a0c taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.553788] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-b81d2b58-2861-4e14-8c5d-17ce60427a0c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.553928] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-b81d2b58-2861-4e14-8c5d-17ce60427a0c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.554352] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-b81d2b58-2861-4e14-8c5d-17ce60427a0c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.554517] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b81d2b58-2861-4e14-8c5d-17ce60427a0c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.726047] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.056767] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.057329] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.057329] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.057586] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.057805] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.057978] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port b81d2b58-2861-4e14-8c5d-17ce60427a0c not found, creating... [ 1247.059029] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.059305] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.059470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.059820] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.059983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.060397] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.060620] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.060780] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.061309] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.061309] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.061414] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: b81d2b58-2861-4e14-8c5d-17ce60427a0c is going to be created. [ 1247.085635] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.085919] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.086105] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.086387] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.086622] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.086847] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-b81d2b58-2861-4e14-8c5d-17ce60427a0c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.228400] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.730664] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.730768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.730884] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.731120] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.731234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.731312] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1247.764630] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.764931] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.765165] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.765581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.765581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.777986] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1247.804259] env[66364]: INFO networking_nsxv3.common.synchronization [req-0dabd785-0447-49ee-932d-0648be03d265 req-a36b88f5-dade-49ac-9220-09fe441bad62 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1247.804259] env[66364]: INFO networking_nsxv3.common.synchronization [req-0dabd785-0447-49ee-932d-0648be03d265 req-a36b88f5-dade-49ac-9220-09fe441bad62 service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1247.804259] env[66364]: INFO networking_nsxv3.common.synchronization [req-0dabd785-0447-49ee-932d-0648be03d265 req-a36b88f5-dade-49ac-9220-09fe441bad62 service nova] Enqueued Resource ID: b81d2b58-2861-4e14-8c5d-17ce60427a0c with Priority: HIGHEST for action port [ 1247.805255] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1247.805255] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1247.805255] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b81d2b58-2861-4e14-8c5d-17ce60427a0c with Priority: HIGHEST for action port [ 1247.805561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.805747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.805859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.806194] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.806376] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.808433] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.808848] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.809212] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-b81d2b58-2861-4e14-8c5d-17ce60427a0c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.809698] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b81d2b58-2861-4e14-8c5d-17ce60427a0c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.809774] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b81d2b58-2861-4e14-8c5d-17ce60427a0c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.810292] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b81d2b58-2861-4e14-8c5d-17ce60427a0c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.810292] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b81d2b58-2861-4e14-8c5d-17ce60427a0c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.308626] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.308947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.312166] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b81d2b58-2861-4e14-8c5d-17ce60427a0c with status ACTIVE [ 1248.312355] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.312473] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.312538] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.312768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.312840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.313009] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.313110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.313167] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.313309] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.313402] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.313627] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.313722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.313784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.313924] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.313991] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.314097] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b81d2b58-2861-4e14-8c5d-17ce60427a0c is going to be updated. [ 1248.343413] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.343575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.343575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.343788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.344012] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.344181] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b81d2b58-2861-4e14-8c5d-17ce60427a0c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.789947] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1249.790343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.790343] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.790569] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.790763] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.790903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.791027] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.791275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.791369] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.791474] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.294580] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.796416] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.299411] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.299621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.299621] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.299803] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.299893] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.299991] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1251.331301] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.331444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.331516] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.331727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.331874] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.342112] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1252.806105] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.806105] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1253.354307] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1253.354490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.354659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.354876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.355091] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.355215] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.355280] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.355461] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.355561] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.355649] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.355739] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.388049] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1253.388246] env[66364]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-1a5f4984-4e9c-4f1e-8c58-de04329cba9e None None] NSXv3 Agent Agent loop - iteration:3 started [ 1253.859367] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.859941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.859941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.859941] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.860266] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.860266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.860266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.860546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.860546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.860546] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.860763] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.860763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.860763] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.861020] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.861020] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.861233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.861233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.861415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.861415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.861415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.861632] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.366053] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c: rpc.has_security_group_logging(os_id): False [ 1254.384738] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.384935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.384935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.385178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.385277] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.385493] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.385588] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.385647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.385807] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.385887] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.386171] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.386269] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.386332] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.386482] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.386552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.386728] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.386835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.386890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.387060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.387151] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.387200] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1254.457987] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.458137] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.458217] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.458429] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.458572] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.476377] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1256.495486] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1256.495861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.486736] env[66364]: INFO networking_nsxv3.common.synchronization [req-2be399b5-9e08-4322-b0c2-e8f6f5afb213 req-55552734-8aee-4100-9d4c-7b52bd1d5048 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1257.487311] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1257.487614] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.487752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.487786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.487977] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.488522] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.488639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.488704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.488867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.488952] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.489065] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.991644] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.495020] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.997278] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.997743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.997743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.997852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.997852] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.997998] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1259.050254] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.050493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.050493] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.050942] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.051170] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.063433] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1261.075468] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1261.075891] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.488816] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.489256] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1264.902186] env[66364]: INFO networking_nsxv3.common.synchronization [req-84543c8c-1d27-4f7f-b1b9-73c98fc21358 req-658d3512-0f63-479c-8df8-44de79c2f5d2 tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1264.903305] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1264.903704] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.903860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.903947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.904251] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.904439] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.904575] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.904653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.904861] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.904986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.905152] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.408132] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.408408] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.408619] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.408935] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.409169] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.409450] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.409616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.409727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.409994] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.410158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.410278] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be updated. [ 1265.443416] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.443653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.443653] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.443846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.443985] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.453449] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: IN_PROGRESS for 2s [ 1266.776951] env[66364]: INFO networking_nsxv3.common.synchronization [req-2dfd270e-3b89-4475-a4c4-1fabfe522ece req-35fd27aa-22b9-493d-a994-644fa56c7865 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1266.777726] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1266.777726] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.777818] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.777860] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.778658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.778658] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.778658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.778658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.778658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.778658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.778658] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.076398] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.076398] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.076398] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.076398] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.076696] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.076696] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.076786] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.077035] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.077149] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.077319] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1267.077435] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1267.077535] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1267.077638] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1267.077743] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1267.077844] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1267.077970] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1267.098228] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1267.098390] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1267.098541] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1267.098714] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-228" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.099039] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-40965379-1faf-480e-a845-1557fc85df42 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.099224] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-40965379-1faf-480e-a845-1557fc85df42" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.099414] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-40965379-1faf-480e-a845-1557fc85df42" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.099757] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-40965379-1faf-480e-a845-1557fc85df42" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.099896] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40965379-1faf-480e-a845-1557fc85df42',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.280705] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.464339] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 1267.464480] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a deletion is rescheduled due to dependency. [ 1267.464520] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.602845] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.603106] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.603169] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.603523] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.603674] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.603828] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Segment Port 40965379-1faf-480e-a845-1557fc85df42 not found, creating... [ 1267.604121] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.604292] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.604406] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.604635] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.604770] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.605065] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.605223] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.605337] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.605543] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.605674] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.605810] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 40965379-1faf-480e-a845-1557fc85df42 is going to be created. [ 1267.626547] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.626795] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.626891] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.627202] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.627433] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.627659] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-40965379-1faf-480e-a845-1557fc85df42" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.784598] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.287864] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.288146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.288146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.288444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.288444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.288521] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1268.320020] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.320189] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.320254] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.320465] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.320616] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.329831] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1268.336400] env[66364]: INFO networking_nsxv3.common.synchronization [req-2dfd270e-3b89-4475-a4c4-1fabfe522ece req-2ffecbbb-2e0a-4d43-aa33-a32cc825950a service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1268.336571] env[66364]: INFO networking_nsxv3.common.synchronization [req-2dfd270e-3b89-4475-a4c4-1fabfe522ece req-2ffecbbb-2e0a-4d43-aa33-a32cc825950a service nova] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1268.336705] env[66364]: INFO networking_nsxv3.common.synchronization [req-2dfd270e-3b89-4475-a4c4-1fabfe522ece req-2ffecbbb-2e0a-4d43-aa33-a32cc825950a service nova] Enqueued Resource ID: 40965379-1faf-480e-a845-1557fc85df42 with Priority: HIGHEST for action port [ 1268.337278] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_rules [ 1268.337409] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1268.337501] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40965379-1faf-480e-a845-1557fc85df42 with Priority: HIGHEST for action port [ 1268.337825] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.337945] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.338015] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.338214] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.338295] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.339108] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.339204] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.339391] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-40965379-1faf-480e-a845-1557fc85df42 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.339488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40965379-1faf-480e-a845-1557fc85df42" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.339552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40965379-1faf-480e-a845-1557fc85df42" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.339713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40965379-1faf-480e-a845-1557fc85df42" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.339785] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40965379-1faf-480e-a845-1557fc85df42',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.841507] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.841913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.841913] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40965379-1faf-480e-a845-1557fc85df42 with status ACTIVE [ 1268.842018] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.842088] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.842156] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.842401] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.842498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.842675] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.842771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.842834] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.842988] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.843085] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.843266] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.843367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.843433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.843545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.843615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.843696] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40965379-1faf-480e-a845-1557fc85df42 is going to be updated. [ 1268.870013] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.870231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.870231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.870446] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.870583] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.870744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40965379-1faf-480e-a845-1557fc85df42" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.328972] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.328972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.328972] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.329474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.329474] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.340017] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1270.340231] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.340974] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.341213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.341402] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.341518] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.341580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.341773] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.341839] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.341925] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.833203] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.844338] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.334791] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.346112] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.837317] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1271.837483] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1271.848433] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.848662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.848662] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.848904] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.848992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.849101] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1271.893215] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.893463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.893463] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.893641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.893760] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.903277] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1272.762465] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.762772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.762772] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.762907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.774822] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1272.775740] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.776889] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1272.816592] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.816808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.816808] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.816993] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.830620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.831454] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1272.831535] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1272.831620] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1272.880065] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.880065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.880065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.880065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.880065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.880793] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1272.976951] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.979021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.979021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.979021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.979021] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.979021] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1273.093532] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.093738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.093838] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.094104] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.094513] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.094851] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1273.094982] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'40420088-ac97-4318-add0-c3b84e42921a', 'ad194291-e1d7-48e3-b3d4-5e26a902dc4b', '5028084e-cee8-4d90-822e-92c0b2a9224a', '1b30b154-6212-47c2-a13c-f42428185a75', 'c000df34-07b2-4015-b824-73615ee8d750', '2333e496-b7f8-4064-8233-f2513788fa94', 'b49ee1f8-75f0-4dc8-86a3-69683601a19d', 'b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c', 'dc470104-8593-4197-8a42-8965abae6489', 'd32f784a-4b9d-4ad9-8cac-3dcf099fea9c', '058d428d-1c40-48eb-bb28-f8d8263ffcf8', '622b5ca5-0010-4122-b9d4-901a52d1aa5c', 'd4c406b1-8de5-46fa-bdd6-2eccaf845753', 'f6d923ea-108c-4ea6-b072-aa5974291da3', '5a7eaf96-c576-4eca-93fe-af95a1f3d6f7', '665d57cc-5dea-494f-b1df-651330cfd64a', '784e3e36-fad9-4cd6-a173-77329b5f03c2', '3a79a858-0e03-4c0f-8127-6d5008465f85', 'a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d', '02c59c8a-da67-420a-8de3-ef613658b83d', 'cb447688-9fc5-4154-bc02-69edb9629669', 'edc73d65-12db-4adf-90af-f7bd6b67d4fd', '37506c58-083d-46d9-8010-be6545a2e954', 'caf65fab-7b8a-4ed0-8b20-496896e11d68', '9f7b3ef5-012b-41d3-8579-50da00ef550e', '85f93bd5-5dca-472e-a30a-fd77d873bad8', 'bb1df802-a3f1-4c8d-a6da-037dbf31eedb', '5165fdef-bf23-471f-87fc-3248cc2d9078', 'df43df14-5db4-47e2-aec2-171f912259af', '2ce5e068-6071-492c-83e7-d1b6b7551653', 'a80c29ba-9fac-4002-9bc5-2c6f28eafc86', 'c50ff812-f9eb-4476-8c5b-45d3cc1a4532', 'c0ad2de4-2360-481d-804e-9be48864280c', 'f0345151-3287-4add-b6b3-bbb72460c6bd', '64957bc0-2496-43d3-8cbd-8653bab5f68b', '9733c7ac-eb57-4467-8d19-d151daebf568', 'd452681b-1b53-41c8-868e-1a2a30ac3a1f', 'bb1358a0-c55b-4cc7-8303-f2d79335b98a', '52d4ebc8-9cd6-4fb8-bf6b-bdc5ffde9789', 'a59a352e-2737-4849-9aff-a8ce9ffcd13d', '8d105259-6c05-4d26-aa23-5631556fbf46', '296f3936-dac0-44a8-a46a-d39ee062c69f', '6b563fa6-e694-4628-a9da-1beb0ee48864', '00daaa8f-5b68-4f84-bd92-74c2b8c0e7a7', 'e327b378-51f2-4bc5-8b1c-697b0302c4a5', '007f96f6-a408-4a76-b5c6-eceae8238916'} {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1273.095096] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1273.117784] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.117784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.117968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.118082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.118171] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.118281] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1273.118351] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1273.118428] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1273.205012] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.205253] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.205301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.205577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.206864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.207199] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1273.207297] env[66364]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66364) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1273.207430] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1273.207500] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1273.207608] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1273.207706] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGH for action security_group_rules [ 1273.207816] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGH for action security_group_rules [ 1273.207910] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGH for action security_group_rules [ 1273.208008] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGH for action security_group_rules [ 1273.208114] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGH for action security_group_rules [ 1273.208207] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGH for action security_group_rules [ 1273.208297] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGH for action security_group_rules [ 1273.208387] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGH for action security_group_rules [ 1273.208474] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGH for action security_group_rules [ 1273.208562] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGH for action security_group_rules [ 1273.208657] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGH for action security_group_rules [ 1273.208749] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGH for action security_group_rules [ 1273.208835] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGH for action security_group_rules [ 1273.208923] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGH for action security_group_rules [ 1273.209014] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGH for action security_group_rules [ 1273.209124] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGH for action security_group_rules [ 1273.209214] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGH for action security_group_rules [ 1273.209304] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGH for action security_group_rules [ 1273.209392] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGH for action security_group_rules [ 1273.209481] env[66364]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGH for action security_group_rules [ 1273.209600] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.338863] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1273.339077] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1273.339188] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40420088-ac97-4318-add0-c3b84e42921a with Priority: HIGH for action security_group_rules [ 1273.339330] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGH for action security_group_rules [ 1273.339427] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d with Priority: HIGH for action security_group_rules [ 1273.339523] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 with Priority: HIGH for action security_group_rules [ 1273.339664] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02c59c8a-da67-420a-8de3-ef613658b83d with Priority: HIGH for action security_group_rules [ 1273.339844] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d with Priority: HIGH for action security_group_rules [ 1273.340029] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 with Priority: HIGH for action security_group_rules [ 1273.340143] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 with Priority: HIGH for action security_group_rules [ 1273.340284] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d923ea-108c-4ea6-b072-aa5974291da3 with Priority: HIGH for action security_group_rules [ 1273.340402] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 665d57cc-5dea-494f-b1df-651330cfd64a with Priority: HIGH for action security_group_rules [ 1273.340495] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 with Priority: HIGH for action security_group_rules [ 1273.340583] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c with Priority: HIGH for action security_group_rules [ 1273.340670] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 with Priority: HIGH for action security_group_rules [ 1273.340759] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c with Priority: HIGH for action security_group_rules [ 1273.340844] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc470104-8593-4197-8a42-8965abae6489 with Priority: HIGH for action security_group_rules [ 1273.340963] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2333e496-b7f8-4064-8233-f2513788fa94 with Priority: HIGH for action security_group_rules [ 1273.341025] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGH for action security_group_rules [ 1273.341109] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c000df34-07b2-4015-b824-73615ee8d750 with Priority: HIGH for action security_group_rules [ 1273.341193] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b with Priority: HIGH for action security_group_rules [ 1273.341306] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b30b154-6212-47c2-a13c-f42428185a75 with Priority: HIGH for action security_group_rules [ 1273.341660] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40420088-ac97-4318-add0-c3b84e42921a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.341845] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.341845] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.342096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.342177] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40420088-ac97-4318-add0-c3b84e42921a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.343143] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.343255] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.343345] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.343531] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.343601] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.344500] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.345878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.345878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.346327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.346327] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b49ee1f8-75f0-4dc8-86a3-69683601a19d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.347139] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.347250] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.347322] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.347488] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.347573] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a7eaf96-c576-4eca-93fe-af95a1f3d6f7',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.348343] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02c59c8a-da67-420a-8de3-ef613658b83d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.348445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.348529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.348687] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.348770] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02c59c8a-da67-420a-8de3-ef613658b83d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.349517] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.349631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.349700] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.349863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.349934] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.350622] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a79a858-0e03-4c0f-8127-6d5008465f85 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.350729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.350792] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.350943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.351040] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a79a858-0e03-4c0f-8127-6d5008465f85',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.351867] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-784e3e36-fad9-4cd6-a173-77329b5f03c2 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.351980] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.352069] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.352203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.352289] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('784e3e36-fad9-4cd6-a173-77329b5f03c2',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.353043] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6d923ea-108c-4ea6-b072-aa5974291da3 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.353110] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.353160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.353312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.353405] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6d923ea-108c-4ea6-b072-aa5974291da3',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.354096] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-665d57cc-5dea-494f-b1df-651330cfd64a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.354203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.354266] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.354443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.354515] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('665d57cc-5dea-494f-b1df-651330cfd64a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.355330] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.355440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.355503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.355672] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.355736] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4c406b1-8de5-46fa-bdd6-2eccaf845753',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.356500] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.356658] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.356729] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.356894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.356968] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('622b5ca5-0010-4122-b9d4-901a52d1aa5c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.357712] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.357823] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.357885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.358059] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.358135] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('058d428d-1c40-48eb-bb28-f8d8263ffcf8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.358821] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.358940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.359025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.359209] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.359286] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d32f784a-4b9d-4ad9-8cac-3dcf099fea9c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.360133] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc470104-8593-4197-8a42-8965abae6489 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.360312] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.360462] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.361158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.361301] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc470104-8593-4197-8a42-8965abae6489',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.362320] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2333e496-b7f8-4064-8233-f2513788fa94 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.362528] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.362641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.362899] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.363037] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2333e496-b7f8-4064-8233-f2513788fa94',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.364083] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.364238] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.364561] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c000df34-07b2-4015-b824-73615ee8d750 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.365213] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.365356] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.365594] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.365731] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c000df34-07b2-4015-b824-73615ee8d750',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.366903] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.367325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.367325] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.367501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.367615] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad194291-e1d7-48e3-b3d4-5e26a902dc4b',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.368640] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b30b154-6212-47c2-a13c-f42428185a75 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.368810] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.368919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.369272] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.369338] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b30b154-6212-47c2-a13c-f42428185a75',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.404191] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.404394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.404394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.404631] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.406517] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.406618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.407503] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.407592] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.408305] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.408399] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.435427] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.435607] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a7eaf96-c576-4eca-93fe-af95a1f3d6f7 is going to be deleted. [ 1273.436822] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.437039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.460307] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.460480] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40420088-ac97-4318-add0-c3b84e42921a is going to be deleted. [ 1273.461357] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.461597] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.494825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.495030] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a79a858-0e03-4c0f-8127-6d5008465f85 is going to be deleted. [ 1273.495859] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.496091] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.520673] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.520898] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be deleted. [ 1273.555312] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.555551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.555551] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.555744] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.555840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.555963] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a79a858-0e03-4c0f-8127-6d5008465f85" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.564026] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.564230] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.564276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.564474] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.564566] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.564686] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40420088-ac97-4318-add0-c3b84e42921a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.568866] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.569028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.569090] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.569326] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.569445] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.569489] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a7eaf96-c576-4eca-93fe-af95a1f3d6f7" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.589463] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.589711] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.589802] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.590056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.590234] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.590379] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.937487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.937989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.937989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.937989] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.939869] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.940036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.940764] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.940855] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.941584] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.941689] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.942415] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.942534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.943277] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.943375] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.944464] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.944586] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.945308] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.945405] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.946052] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1273.946294] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.946457] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.946666] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.946858] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.946958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.947041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.947224] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.947313] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.947394] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.947506] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.949066] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.949201] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.950069] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.950159] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.950800] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.951231] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.951324] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.952021] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.952426] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.952548] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.953260] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.953697] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.953806] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.954556] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.954943] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.955073] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.955935] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.956364] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.956496] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.962123] env[66364]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.962559] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.962702] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6d923ea-108c-4ea6-b072-aa5974291da3 is going to be deleted. [ 1273.963881] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.964113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.995295] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.995481] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b49ee1f8-75f0-4dc8-86a3-69683601a19d is going to be deleted. [ 1273.996501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.996710] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.027761] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.027961] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc470104-8593-4197-8a42-8965abae6489 is going to be deleted. [ 1274.028786] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.029025] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.031218] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.031317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.088459] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.088651] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c000df34-07b2-4015-b824-73615ee8d750 is going to be deleted. [ 1274.089553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.089784] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.138891] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.139178] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.149659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.149779] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad194291-e1d7-48e3-b3d4-5e26a902dc4b is going to be deleted. [ 1274.150800] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.151028] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.201990] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.202156] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 665d57cc-5dea-494f-b1df-651330cfd64a is going to be deleted. [ 1274.203220] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.203540] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.205752] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.205907] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.249105] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.249308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.278871] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.278986] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2333e496-b7f8-4064-8233-f2513788fa94 is going to be deleted. [ 1274.280036] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.280693] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.307444] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.307444] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.335082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.335082] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d32f784a-4b9d-4ad9-8cac-3dcf099fea9c is going to be deleted. [ 1274.335082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.335082] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.444477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.444477] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d is going to be deleted. [ 1274.445454] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.445736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.447741] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.447921] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.448974] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.449086] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.456659] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.456819] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.456870] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.457097] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.457318] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.457435] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.457501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.457676] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.457768] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.457872] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.458017] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.458111] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.458173] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.458323] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.458462] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.458554] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.458612] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.458752] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.458830] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.458912] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.458998] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.496853] env[66364]: INFO networking_nsxv3.common.synchronization [req-7b5bc9f3-7ce3-4357-92fc-f539f315676a req-91cc40f6-e90d-4751-afae-83d5a4cd52c2 tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1274.497646] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1274.497727] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.497864] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.497913] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.498225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.498391] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.498502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.498581] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.498751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.498836] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.498929] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.519609] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.519609] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02c59c8a-da67-420a-8de3-ef613658b83d is going to be deleted. [ 1274.520367] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.520606] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.526093] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.526285] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.556999] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.557181] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b30b154-6212-47c2-a13c-f42428185a75 is going to be deleted. [ 1274.558077] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.558296] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.654869] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.655062] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 058d428d-1c40-48eb-bb28-f8d8263ffcf8 is going to be deleted. [ 1274.656477] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.656736] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.685291] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.685539] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.829461] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.829749] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.829911] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.830253] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.830582] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.830766] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.830909] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.831205] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.831396] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.831668] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.831824] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.831945] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.832096] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.832216] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.832356] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.832491] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.943267] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.943688] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4c406b1-8de5-46fa-bdd6-2eccaf845753 is going to be deleted. [ 1274.944476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.944715] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.946402] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.946594] env[66364]: DEBUG dogpile.cache.region [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Cache value generated in 0.114 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.946718] env[66364]: DEBUG dogpile.lock [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.946918] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "network-545" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.947314] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock port-0777fcc7-781c-44cd-ac41-208221c0b958 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.947505] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "port-0777fcc7-781c-44cd-ac41-208221c0b958" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.947633] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "port-0777fcc7-781c-44cd-ac41-208221c0b958" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.947992] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "port-0777fcc7-781c-44cd-ac41-208221c0b958" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.948175] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0777fcc7-781c-44cd-ac41-208221c0b958',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.951341] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.951341] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.961590] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c: rpc.has_security_group_logging(os_id): False [ 1274.997873] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.998095] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.001952] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.002144] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.022436] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.022751] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.038216] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.038429] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 622b5ca5-0010-4122-b9d4-901a52d1aa5c is going to be deleted. [ 1275.039580] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.039857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.099689] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.099876] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.110109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.110315] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 784e3e36-fad9-4cd6-a173-77329b5f03c2 is going to be deleted. [ 1275.111311] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.111562] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.111659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.111785] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6d923ea-108c-4ea6-b072-aa5974291da3" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.111946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.112126] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.112208] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.112327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc470104-8593-4197-8a42-8965abae6489" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.112953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.113223] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.113314] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.113433] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b49ee1f8-75f0-4dc8-86a3-69683601a19d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.113564] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.113716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.113788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.113901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c000df34-07b2-4015-b824-73615ee8d750" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.114049] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.114196] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.114276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.114442] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad194291-e1d7-48e3-b3d4-5e26a902dc4b" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.114578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.114722] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.114811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.114929] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2333e496-b7f8-4064-8233-f2513788fa94" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.115061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.115200] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.115275] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.115387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-665d57cc-5dea-494f-b1df-651330cfd64a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.115556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.115704] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.115776] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.115890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d32f784a-4b9d-4ad9-8cac-3dcf099fea9c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.116022] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.116160] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.116261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.116380] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a14f4a8f-0c8c-4c6a-95ec-cb8b7fa2cd3d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.116504] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.116644] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.116716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.116826] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02c59c8a-da67-420a-8de3-ef613658b83d" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.116943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.117130] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.117221] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.117350] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b30b154-6212-47c2-a13c-f42428185a75" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.117476] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.117615] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.117688] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.117911] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.118039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.118099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.118240] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.118315] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.118407] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be deleted. [ 1275.119383] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.119545] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.127450] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.127648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.220158] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.220460] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.220590] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.220656] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.220863] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.220947] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.221181] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.221284] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.221346] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.221499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.221577] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.221755] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.221825] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.221885] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.222033] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.222107] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.222196] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1275.223327] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.223452] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.223537] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.223648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-058d428d-1c40-48eb-bb28-f8d8263ffcf8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.223779] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.223919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.223992] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.224113] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4c406b1-8de5-46fa-bdd6-2eccaf845753" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.247292] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.247543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.247543] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.247857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.247857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.247979] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-784e3e36-fad9-4cd6-a173-77329b5f03c2" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.250234] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.250425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.250425] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.250664] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.250804] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.250970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.270205] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.270415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.270415] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.270627] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.270718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.270840] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-622b5ca5-0010-4122-b9d4-901a52d1aa5c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.447670] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.447900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.447900] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.448109] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.448258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.453236] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.453489] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.453621] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.453892] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.454053] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.454209] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Segment Port 0777fcc7-781c-44cd-ac41-208221c0b958 not found, creating... [ 1275.454469] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.454626] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.454740] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.454965] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.455113] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.455392] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.455547] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.455659] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.455867] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.455998] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.456148] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Resource: SegmentPort with ID: 0777fcc7-781c-44cd-ac41-208221c0b958 is going to be created. [ 1275.483516] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1275.503608] env[66364]: DEBUG networking_nsxv3.common.locking [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.503608] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.503882] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.503983] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.504216] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.504470] env[66364]: DEBUG oslo_concurrency.lockutils [None req-44a78245-3b53-4280-8fe4-881976efa78b None None] Releasing lock "port-0777fcc7-781c-44cd-ac41-208221c0b958" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.102782] env[66364]: INFO networking_nsxv3.common.synchronization [req-7b5bc9f3-7ce3-4357-92fc-f539f315676a req-a060553c-6b98-406a-bde1-b92578788e0b service nova] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 1276.103185] env[66364]: INFO networking_nsxv3.common.synchronization [req-7b5bc9f3-7ce3-4357-92fc-f539f315676a req-a060553c-6b98-406a-bde1-b92578788e0b service nova] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1276.103185] env[66364]: INFO networking_nsxv3.common.synchronization [req-7b5bc9f3-7ce3-4357-92fc-f539f315676a req-a060553c-6b98-406a-bde1-b92578788e0b service nova] Enqueued Resource ID: 0777fcc7-781c-44cd-ac41-208221c0b958 with Priority: HIGHEST for action port [ 1276.103348] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_rules [ 1276.103457] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1276.103551] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0777fcc7-781c-44cd-ac41-208221c0b958 with Priority: HIGHEST for action port [ 1276.104366] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.104534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.104685] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.104815] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.104878] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.105830] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.105932] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.106029] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.106233] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.106346] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.106439] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.106494] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.106639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.106721] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.106813] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.107627] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-0777fcc7-781c-44cd-ac41-208221c0b958 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.108620] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0777fcc7-781c-44cd-ac41-208221c0b958" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.108695] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0777fcc7-781c-44cd-ac41-208221c0b958" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.108867] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0777fcc7-781c-44cd-ac41-208221c0b958" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.108947] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0777fcc7-781c-44cd-ac41-208221c0b958',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.611316] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.611517] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.611937] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.612908] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0777fcc7-781c-44cd-ac41-208221c0b958 with status ACTIVE [ 1276.613127] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.613248] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.613922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.613922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.613922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.613922] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.613922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.613922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.614364] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.614364] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.614428] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.614584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.614584] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.614731] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.614795] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.614942] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0777fcc7-781c-44cd-ac41-208221c0b958 is going to be updated. [ 1276.646312] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.646529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.646529] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.646811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.646964] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.647299] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0777fcc7-781c-44cd-ac41-208221c0b958" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.117280] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.501883] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1277.502134] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.502308] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.502534] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.502635] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.620081] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.620288] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.620338] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.620552] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.620647] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.620745] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be created. [ 1277.648200] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.648443] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.648553] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.648831] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.649056] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.659698] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: UNINITIALIZED for 2s [ 1278.004507] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.004713] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.004781] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.005096] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.005330] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.005470] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.005556] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.005771] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.005866] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.005959] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.006098] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.508579] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.508983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.508983] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.509132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.509301] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.509412] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.509479] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.509632] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.509718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.509805] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.509951] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.510057] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.510115] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.510259] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.510396] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.510486] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.510547] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.510764] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.510865] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.510981] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.511120] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.013156] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c: rpc.has_security_group_logging(os_id): False [ 1279.033529] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.033739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.033739] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.033936] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.034105] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.034366] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.034738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.034738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.034738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.034873] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.035081] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.035081] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.035276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.035276] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.035340] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.035487] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.035578] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.035639] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.035767] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.035844] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.035923] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1279.103433] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.103648] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.103716] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.103890] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.104050] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.124127] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1279.671985] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 1279.672499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.672499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.672727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.672921] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.673060] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.673146] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.673291] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.673398] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.673502] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.673576] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.176544] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.432328] env[66364]: INFO networking_nsxv3.common.synchronization [req-8a0910a5-94bb-43dc-88bc-c68a53bd3801 req-bbca8e29-4a90-40b7-bd98-6fbacf02b481 tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1280.432682] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1280.432986] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.433177] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.433261] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.433471] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.433631] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.433732] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.433793] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.433943] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.434039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.434133] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.679224] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5028084e-cee8-4d90-822e-92c0b2a9224a: rpc.has_security_group_logging(os_id): False [ 1280.701883] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.702166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.702166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.702329] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.702421] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.702739] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.702857] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.702922] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.703133] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.703225] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.703314] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be created. [ 1280.766605] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.766837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.766837] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.767039] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.767236] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.780719] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: IN_PROGRESS for 2s [ 1280.936539] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.141611] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1281.141914] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.438654] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.941616] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.941958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.941958] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.942166] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.942282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.942380] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1281.974307] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.974512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.974512] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.974718] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.974862] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.984064] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1282.794240] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 1282.794490] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.995397] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1283.995756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.434136] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.434544] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1286.766875] env[66364]: INFO networking_nsxv3.common.synchronization [req-a5dd403b-0c9d-41e8-97ea-941c6ec63216 req-63c2dc1f-6133-412e-85fa-6cdfad9f262e tempest-ServersTestJSON-1051304972 tempest-ServersTestJSON-1051304972-project-member] Enqueued Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1286.767494] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c with Priority: HIGHEST for action security_group_members [ 1286.767798] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.767970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.767970] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.768339] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.768743] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.768743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.768743] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.768953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.768953] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.769037] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.271589] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.271811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.271811] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.271986] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.272099] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.272296] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.272395] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.272456] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.272610] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.272684] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.272780] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c is going to be updated. [ 1287.303396] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.303608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.303608] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.303919] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.304162] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.312908] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: IN_PROGRESS for 2s [ 1289.323659] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c in Status: SUCCESS [ 1289.323659] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c deletion is rescheduled due to dependency. [ 1289.323659] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b8b6a3fe-79ef-4f9c-9ac6-3a2a7d805d2c" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.771146] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.771469] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.772157] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1296.772638] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1297.060930] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock network-568 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.061150] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.061271] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.061533] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.061789] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.061942] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.062067] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.062279] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.062423] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.062631] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1297.062739] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] NeedRegenerationException {{(pid=66364) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1297.062843] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] no value, waiting for create lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1297.062948] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] value creation lock acquired {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1297.063066] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] No value present for key: 'zone-id' {{(pid=66364) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1297.063169] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Calling creation function for not-yet-present value {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1297.063294] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1297.084738] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1297.084916] env[66364]: DEBUG dogpile.cache.region [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66364) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1297.085033] env[66364]: DEBUG dogpile.lock [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Released creation lock {{(pid=66364) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1297.085215] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "network-568" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.085525] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock port-7e792c83-b4e8-4ca6-a117-a75234a4b104 taken with stack trace [, , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.085697] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.085816] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.086077] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.086213] env[66364]: DEBUG networking_nsxv3.api.rpc [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e792c83-b4e8-4ca6-a117-a75234a4b104',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.588889] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.589171] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.589171] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.589520] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.589688] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.589940] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.590101] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.590220] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.590506] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.590614] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.591050] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.591050] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.591222] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.591373] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.591511] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.591680] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Resource: SegmentPort with ID: 7e792c83-b4e8-4ca6-a117-a75234a4b104 is going to be updated. [ 1297.619203] env[66364]: DEBUG networking_nsxv3.common.locking [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.619455] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.619532] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.619829] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.620038] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.620263] env[66364]: DEBUG oslo_concurrency.lockutils [None req-22e24874-5ad5-42f9-af25-131dffd5e2b9 None None] Releasing lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.326570] env[66364]: INFO networking_nsxv3.common.synchronization [req-b8efe519-fd37-4d28-b95d-aa091cdd786a req-2922c7f2-f26f-483a-9088-d2519c70a114 service nova] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 1298.326874] env[66364]: INFO networking_nsxv3.common.synchronization [req-b8efe519-fd37-4d28-b95d-aa091cdd786a req-2922c7f2-f26f-483a-9088-d2519c70a114 service nova] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1298.326874] env[66364]: INFO networking_nsxv3.common.synchronization [req-b8efe519-fd37-4d28-b95d-aa091cdd786a req-2922c7f2-f26f-483a-9088-d2519c70a114 service nova] Enqueued Resource ID: 7e792c83-b4e8-4ca6-a117-a75234a4b104 with Priority: HIGHEST for action port [ 1298.327532] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_rules [ 1298.327690] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1298.327795] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e792c83-b4e8-4ca6-a117-a75234a4b104 with Priority: HIGHEST for action port [ 1298.328081] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.328203] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.328268] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.328495] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.328581] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.329711] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.329824] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.329888] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.330190] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.330344] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.330440] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.330499] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.330645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.330747] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.330829] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.331917] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e792c83-b4e8-4ca6-a117-a75234a4b104 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.332058] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.332136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.332392] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.332461] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e792c83-b4e8-4ca6-a117-a75234a4b104',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.835061] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e792c83-b4e8-4ca6-a117-a75234a4b104 with status ACTIVE [ 1298.835061] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.835061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.835061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.835061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.835061] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.835441] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.835441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.835441] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.835563] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.835598] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.835758] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.835846] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.835901] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.836046] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.836117] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.836199] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e792c83-b4e8-4ca6-a117-a75234a4b104 is going to be updated. [ 1298.837382] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.837498] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.837659] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.858870] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.859068] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.859122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.859298] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.859432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.859589] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e792c83-b4e8-4ca6-a117-a75234a4b104" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.340602] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.842981] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.843249] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.843301] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.843532] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.843637] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.843747] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1299.873644] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.873878] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.873973] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.874387] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.874603] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.885412] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1301.897801] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1301.898258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.898258] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.898397] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.898593] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.898724] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.898788] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.898946] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.899041] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.899122] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.899218] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.401439] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.904515] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85f93bd5-5dca-472e-a30a-fd77d873bad8: rpc.has_security_group_logging(os_id): False [ 1302.926474] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.926679] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.926756] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.927031] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.948503] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.948848] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.949065] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.949125] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.949347] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.949484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.949642] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1303.013655] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.013894] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.013939] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.014263] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.014481] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.029265] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1303.329307] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.329497] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1305.048902] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1305.049369] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.330444] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.330837] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1313.331421] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.331797] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1313.722100] env[66364]: INFO networking_nsxv3.common.synchronization [req-4cae3b17-6841-4ee8-968a-887f00675c41 req-09cf893c-0dd5-4ec7-a384-da1b5866b12e tempest-ServerActionsTestOtherB-1668111998 tempest-ServerActionsTestOtherB-1668111998-project-member] Enqueued Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1313.722381] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 with Priority: HIGHEST for action security_group_members [ 1313.722689] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f93bd5-5dca-472e-a30a-fd77d873bad8 taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.722813] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.722879] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.723641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.723641] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.723641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.723641] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.723816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.723816] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.723882] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f93bd5-5dca-472e-a30a-fd77d873bad8',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.225736] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.225898] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.225968] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.226219] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.226319] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.226574] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.226675] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.226738] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.226903] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.227010] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.227075] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 is going to be updated. [ 1314.279091] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.279317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.279317] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.279501] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.279645] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.288544] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: IN_PROGRESS for 2s [ 1316.300082] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 in Status: SUCCESS [ 1316.300508] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f93bd5-5dca-472e-a30a-fd77d873bad8 deletion is rescheduled due to dependency. [ 1316.300508] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f93bd5-5dca-472e-a30a-fd77d873bad8" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.723755] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.724154] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.726951] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.726951] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1328.727735] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.728227] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.728723] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1333.728723] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1336.477634] env[66364]: INFO networking_nsxv3.common.synchronization [req-cc4b62d0-528d-4aa8-9ced-c84544b92b52 req-16d78c6e-54d3-4ea5-b379-e317c20d4002 tempest-ServerActionsTestJSON-1440256796 tempest-ServerActionsTestJSON-1440256796-project-member] Enqueued Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1336.478180] env[66364]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5028084e-cee8-4d90-822e-92c0b2a9224a with Priority: HIGHEST for action security_group_members [ 1336.478478] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock member-5028084e-cee8-4d90-822e-92c0b2a9224a taken with stack trace [, , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.478618] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.478940] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.479179] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.479340] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.479450] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.479491] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.479642] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.479727] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.479817] env[66364]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5028084e-cee8-4d90-822e-92c0b2a9224a',) {} {{(pid=66364) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.981709] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.981948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.981948] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.982282] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.982432] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.982652] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.982766] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.982835] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.983030] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.983132] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.983224] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a is going to be updated. [ 1337.012916] env[66364]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66364) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.013136] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.013260] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.013484] env[66364]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.013629] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.022346] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: IN_PROGRESS for 2s [ 1339.034053] env[66364]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5028084e-cee8-4d90-822e-92c0b2a9224a in Status: SUCCESS [ 1339.034053] env[66364]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5028084e-cee8-4d90-822e-92c0b2a9224a deletion is rescheduled due to dependency. [ 1339.034053] env[66364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5028084e-cee8-4d90-822e-92c0b2a9224a" {{(pid=66364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.480189] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.480443] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1346.481493] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1346.481871] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.482517] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.482937] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1356.484372] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.484937] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.486201] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.486577] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.487686] env[66364]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.488066] env[66364]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0